DPlot Forum Index DPlot
http://www.dplot.com
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Data Cull

 
Post new topic   Reply to topic    DPlot Forum Index -> Suggestions/Questions
View previous topic :: View next topic  
Author Message
Lurking



Joined: 24 May 2010
Posts: 29

PostPosted: Thu Sep 09, 2010 7:14 pm    Post subject: Data Cull Reply with quote

Just a thought... and if it's in there already, my apologies.

How about a way to cull all data outside of the the bounds of what your extents are set to? I ask because after grinding through a massive terrain set, I only wanted to keep that part that I was interested in.

My current method is to take the 129Meg+ SRTM .asc file and convert it to a generic point text file [with LandSerf] after paring it down to the area of interest, then replacing the tab delimiter with a comma [with UltraEdit], then into Dplot with the terrain data. I still get sizable files and after tweeking it down to what I'm interested in, and I'd like to toss all the data outside of the area of interest.
Back to top
View user's profile Send private message
DPlotAdmin
Site Admin


Joined: 24 Jun 2003
Posts: 2310
Location: Vicksburg, Mississippi

PostPosted: Fri Sep 10, 2010 9:18 am    Post subject: Reply with quote

While viewing in 2D, see Edit>Crop. When looking at the entire data set it doesn't give the sort of control you probably want, but if you've already entered the extents you'd like then it is handy: just drag the cursor from one corner of the plot to the other.
_________________
Visualize Your Data
support@dplot.com
Back to top
View user's profile Send private message Send e-mail Visit poster's website
Lurking



Joined: 24 May 2010
Posts: 29

PostPosted: Fri Sep 10, 2010 10:58 am    Post subject: Reply with quote

Thanks for the response. Handy for 2D but I sort of need that 3rd axis data. My version of Excel can't handle more than 65K points, and to down-sample it prior to the importing costs resolution.

Still mulling this over.
Back to top
View user's profile Send private message
DPlotAdmin
Site Admin


Joined: 24 Jun 2003
Posts: 2310
Location: Vicksburg, Mississippi

PostPosted: Fri Sep 10, 2010 4:25 pm    Post subject: Reply with quote

I haven't previously seen a need for a "Clip Z" command. It would be easy enough to add, but you should be aware that without also setting the plot extents to those same Z values you'll still get triangles generated where you expect to see holes.
_________________
Visualize Your Data
support@dplot.com
Back to top
View user's profile Send private message Send e-mail Visit poster's website
Lurking



Joined: 24 May 2010
Posts: 29

PostPosted: Fri Sep 10, 2010 8:54 pm    Post subject: Reply with quote

Mainly I'm looking to use it on scatter plots. I ran into the weird triangle effects when deleting parts of a surface plot. Most un-nerving.
Back to top
View user's profile Send private message
DPlotAdmin
Site Admin


Joined: 24 Jun 2003
Posts: 2310
Location: Vicksburg, Mississippi

PostPosted: Fri Sep 10, 2010 10:13 pm    Post subject: Reply with quote

Just an FYI: It really isn't that weird once you consider what you're giving DPlot to work with (X,Y,Z points). There's no information in that data about where boundaries should be. DPlot generates a convex triangular mesh, and for X,Y,Z points with no boundary conditions specified there's really no solution that makes better sense. You can specify X,Y boundary points with Options>Define Boundary or specify the extents with Options>Extents/Intervals/Size, but in either case that information will not be saved to a simple CSV file, which it sounds like is what you're after.
_________________
Visualize Your Data
support@dplot.com
Back to top
View user's profile Send private message Send e-mail Visit poster's website
Lurking



Joined: 24 May 2010
Posts: 29

PostPosted: Sat Sep 11, 2010 1:40 am    Post subject: Reply with quote

I have found the ability to get partway there... at least it's workable. Not elegant, but highly functional. I was able to wrangle UltraEdit into a sort by column and could slice off the ends of the data I didn't want.


The terrain was pared down to the area of interest. The lower plot was done separately and pasted onto the bottom.





Interesting... It labeled the Deg North as East... and the West axis is correct. The scatter plot of the quakes came out correct.

Here is a merged version of the quake scatter and the terrain surface. Now that is weird. Dunno why it did that.

Back to top
View user's profile Send private message
Lurking



Joined: 24 May 2010
Posts: 29

PostPosted: Sat Sep 11, 2010 3:12 am    Post subject: Reply with quote

Okay... this is making my head hurt. I make a scatter of the surface and the N/S/E/W comes out correct. I make a surface of the scatter, still good. Scatter of the surface again, still good. Kill all of those and go back to the original, take away the N/S/E/W, switch to default number format. Switch back to deg/min, turn on the N/S/E/W and it's wrong.

Hmm... You don't think that there could be an extra line feed or character horking my data set do you?
Back to top
View user's profile Send private message
DPlotAdmin
Site Admin


Joined: 24 Jun 2003
Posts: 2310
Location: Vicksburg, Mississippi

PostPosted: Sat Sep 11, 2010 8:37 am    Post subject: Reply with quote

Sorry for the trouble. You found a bug. It's fixed here and will be available later today.
_________________
Visualize Your Data
support@dplot.com
Back to top
View user's profile Send private message Send e-mail Visit poster's website
Lurking



Joined: 24 May 2010
Posts: 29

PostPosted: Sat Sep 11, 2010 12:02 pm    Post subject: Reply with quote

Actually... (to me) that's a good thing. I thought I had mangled part of the data.
Back to top
View user's profile Send private message
DPlotAdmin
Site Admin


Joined: 24 Jun 2003
Posts: 2310
Location: Vicksburg, Mississippi

PostPosted: Sat Sep 11, 2010 6:32 pm    Post subject: Reply with quote

There's no "Clip Z" - I'll try to have that in the next release. But the bug you found is fixed. If you signed up for the mailing list you'll soon get an e-mail with download instructions. Otherwise you can use "Check for Updates" on the Help menu.

And thanks for pointing out this problem.
_________________
Visualize Your Data
support@dplot.com
Back to top
View user's profile Send private message Send e-mail Visit poster's website
Lurking



Joined: 24 May 2010
Posts: 29

PostPosted: Sat Sep 11, 2010 6:39 pm    Post subject: Reply with quote

Works like a champ. Thank You!

As for the cull, it's not a show stopper, I just didn't know If I had missed it somewhere.
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   Reply to topic    DPlot Forum Index -> Suggestions/Questions All times are GMT - 5 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2005 phpBB Group