DPlot Forum Index DPlot
http://www.dplot.com
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Data Aberration deletion

 
Post new topic   Reply to topic    DPlot Forum Index -> Suggestions/Questions
View previous topic :: View next topic  
Author Message
forresrw



Joined: 13 Apr 2004
Posts: 2

PostPosted: Tue Apr 13, 2004 11:24 am    Post subject: Data Aberration deletion Reply with quote

I've been plotting some large data files (600,000 points) and have been having a hard time deleting some of the aberrant data. It is easy to see graphically, but almost impossible to delete from the original data. The faulty data is very different from the real data, but is intermixed with real data points. The aberration isn't just noise, it's a large spike in the data. The capability to graphically select and delete data points would be very nice. If there is another method for accomplishing this, I'd love to hear it. Thanks. -Rich Forrest
Back to top
View user's profile Send private message
DPlotAdmin
Site Admin


Joined: 24 Jun 2003
Posts: 2310
Location: Vicksburg, Mississippi

PostPosted: Tue Apr 13, 2004 1:38 pm    Post subject: Reply with quote

Two things to look at: Edit>Filter, under "Filter type" choose "Random spike removal". Click the "Help" button for a description of what DPlot considers a random spike.

If you don't have a very large number of points to delete, the "Edit Mode" button should be useful (11th button from the left). You can click on your "bad" data points and delete them. With 600,000 points you'll likely need to first zoom in.
_________________
Visualize Your Data
support@dplot.com
Back to top
View user's profile Send private message Send e-mail Visit poster's website
forresrw



Joined: 13 Apr 2004
Posts: 2

PostPosted: Mon Apr 26, 2004 3:23 pm    Post subject: Data Aberration Deletion Reply with quote

Thanks, your suggestions helped quite a bit. The random spike removal doesn't really work for me. My data values don't have constant spacing. Is there a way to filter the data without having constant spacing? Also, the edit mode button works great, but it would be nice if I could draw a box around the points I want to delete. This would facilitate the deletion of large numbers of points.

Also, a second question about specifying extents in the options menu. Sometimes I specify an extent, but DPLOT does not use the value I chose. Any ideas? Thank you very much for your help.
-Rich Forrest
Back to top
View user's profile Send private message
DPlotAdmin
Site Admin


Joined: 24 Jun 2003
Posts: 2310
Location: Vicksburg, Mississippi

PostPosted: Mon Apr 26, 2004 3:39 pm    Post subject: Reply with quote

Rich,
Quote:
Thanks, your suggestions helped quite a bit. The random spike removal doesn't really work for me. My data values don't have constant spacing. Is there a way to filter the data without having constant spacing?


I should relax that requirement for the random spike removal. For the other filters... constant spacing isn't mathematically a requirement, but the operations don't do what you intend for them to do (remove a frequency band, for example) unless the spacing IS constant. Really the random spike removal is a bit out of place here; I'll most likely make that a separate menu command, along with allowing you to enter a parameter or two that helps define what a spike is.

Quote:
Also, the edit mode button works great, but it would be nice if I could draw a box around the points I want to delete. This would facilitate the deletion of large numbers of points.


I'll add this one to the to-do list. Again, this will probably be a separate function on the Edit menu... "Delete points within box" or something like that.

Quote:
Also, a second question about specifying extents in the options menu. Sometimes I specify an extent, but DPLOT does not use the value I chose. Any ideas? Thank you very much for your help.


You most likely have "Auto-tick marks" checked under Tick marks. In other words you're allowing DPlot to pick a tick mark interval. OR you have "Specify interval" checked, but the extents you've specified aren't a multiple of that interval. In the former case, this paragraph from the Help file explains the problem:

"The actual coordinates of the corners may not turn out to be exactly the same as those you have specified. DPlot will adjust the extents such that the resulting tick mark intervals are multiples of 1, 1.5, 2, 2.5, 3, 4, 5, 6, or 8 times a power of 10."

The gyrations DPlot goes through to pick a tick mark interval when you have "Auto-tick marks" checked is too wordy to mention here. The short version is - if the actual extents are important to you, you should also use "Specify number" or "Specify interval" under "Tick marks".
_________________
Visualize Your Data
support@dplot.com
Back to top
View user's profile Send private message Send e-mail Visit poster's website
Display posts from previous:   
Post new topic   Reply to topic    DPlot Forum Index -> Suggestions/Questions All times are GMT - 5 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2005 phpBB Group