I've posted this on reddit first, but then someone showed up in the comments with some more workflow videos, and I thought that recording my own writhing a blog video is not a bad idea. So this one is for showing off in two different ways.
Here's a video of a script I wrote for work. What it does is take a file with a list of domains and checks if those domains:
- resolve into somtheing.
- have a website on the thing they point to.
...and then it spits out some SQL to feed into sqlite3. It's easier to work with 5 million entries when they are in a db.