here are my favorite text processing, some advance, some basic all awesome!
updated: 20220127 - added text processor project, and cover photo
Word Frequency Analysis
Hands Down the Best Frequency Analysis tool
Visualizing word frequency over text body length, word counting, and much more.
Really big datasets, like 1-2 mb text files. its the browser anyways so id expect as much
Research Level Text analysis
This one is the most complex on the list, but can do magical things if you learn it.
Handles scraping fro a url, which is very usefull
Check out the prepare tab, has usefull tools for cleaning up your data
Creates word clouds (visualize> wordcloud)
bubble vis is cool (visualize>bubblevis)
Creates word frequency over the length of a text doc
beautiful regex viewer
not really a text processing tool, but is my goto testing tool for regex
Check out the 'replace' tab this is great for messing with capture groups
Heres how it works
see how the << >> is added
Anything within the ( ) is what is 'captured' as a 'group' hense 'capture group'. add ( ) around what you want to replace or keep as part of your regex expression
very usefull for debugging a complex regex expression
This is good for when you want to have mini tests for part of a regex, especially helpfull when the regex starts to get really complex.
Example of regex not matching
Sometimes not matching is exactly what you want. so change the dropdown to
Now see what happens
Your test passed! awesome, this is good for seeing if there was regression with your regex
There also is a match full option too.
this is good for when you want more strict user input like a password or spacific date type
Adding ^ ( means text must start with blah) is helpfull in this case
$ (means string ends with blah)
Usecase when developing code
Add a regexer explainer link right into the comments of the function that uses regex, this way its really easy to get a intuitive understanding of that the regex does. great communication tool with other people, or your future self
Click save and copy the link
example of what that would look like in source code
Also they have a great reference manual for regex if your not super familial with it.
Not really a tool but a collection of usefull tools for doing really simple things
example of a tool i used reciently
Remove all duplicate lines
See how all the duplicate "AAAA"s got removed just leaving the single one.
What I like:
1) all the options that they have for each tool
2) The non complicated language they use
very helpfull when i dont know how to do a task.
Text Processing Tool
created by me, and is a work in progress
Goal of the project:
Make manual text processing real easy, for shitty unformated data
I added this Text gen because...well.. Its just really cool....😇
Live link to play with it:
Thanks for reading!
Check out my other posts on cool tools!
by oran collins