readme-crawler

Crawler Script for GitHub READMEs.

Usage

1. Run $ pip install -r requirements.txt in the repository
2. In the readme_scraper.py, you can change the lines that indicate the URLs to be scraped:

[
    # provide the url list here :-)
    "https://github.com/streamlit/streamlit",
    "https://github.com/CrowdDevHQ/awesome-community-building",
]