Somewhere Toward the Beginning
It's after 1 a.m. A while back I learned some webscraping and collected about 20,000 recipes from a site...then I started a Java class and forgot all about my little python recipe project. Since then the innards of the site I was scraping changed quite a bit. I'm working through learning a lesson right now. I was developing a traversal from the base url to the data, but I wasn't saving the actual data I was getting. So, now I have a bunch of urls to the data that I need. I left a big hole: my webscraping project was using a url to start from and developed from there. I think the real goal of the project should have been actually collecting the data. Websites change everyday, fast. I could have had this nice complete set and move on to learning databasing, but I have to re-scrape all of this data again. Shit. This time I will be scraping a more complete data set to work with.