Posted inProgramming Projects
Python – Simple URL Extractor
This one is pretty basic tier, but more useful than most. I had a website full of links to pages of video files. I wanted a list that I could stick into yt-dlp. I could do a bunch of copy and pasting, or I could use Python to scrape and take all the links. It takes a URL as a CLI Argument, specifically like: > main.py https://website.com It skims the page with Beautiful Soup and spits out a text file with the date-time-url.txt format. Useful if a site changes over time. The site I was scraping was using some relative…