leetcode_scraper_and_pdf
A leetcode scraper to compile all questions in leetcode free tier to text file. pdf also available.
if new questions get added
Open google chrome, navigate to leetcode problems page click on inspect, navigate to dev console and paste the commands below. Copy question links and paste in text file named question_links.txt go to next page and repeat till you have all the questions links. Put the python script and question links file in same folder. run and wait to compile to text file, the convert to pdf online.
var x = document.querySelectorAll("a");
var myarray = []
for (var i=0; i
-1 && x[i].getAttribute('href').indexOf('solution') == -1 )
{
var cleanlink = x[i].href;
myarray.push([cleanlink]);
}
};
function make_table() {
var table = '
Links |
---|
'; for (var i=0; i
" myarray[i][0] ; }; var w="window.open("");" w.document.write(table); } make_table() < code>
Links
Screenhook is a script that captures an image of a web page and send it to a discord webhook.
screenshot from the web for discord webhooks screenhook is a script that captures an image of a web page and send it to a discord webhook.
3 Jun 04, 2022
OSTA web scraper, for checking the status of school buses in Ottawa
OSTA-La-Vista OSTA web scraper, for checking the status of school buses in Ottawa. Getting Started Using a Raspberry Pi, download Python 3, and option
1 Jan 28, 2022
Example of scraping a paginated API endpoint and dumping the data into a DB
Provider API Scraper Example Example of scraping a paginated API endpoint and dumping the data into a DB. Pre-requisits Python = 3.9 Pipenv Setup # i
1 Oct 20, 2021
A web scraping pipeline project that retrieves TV and movie data from two sources, then transforms and stores data in a MySQL database.
New to Streaming Scraper An in-progress web scraping project built with Python, R, and SQL. The scraped data are movie and TV show information. The go
1 Mar 28, 2022
Bigdata - This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster
Scrapy Cluster This Scrapy project uses Redis and Kafka to create a distributed
0 Jan 06, 2022
Minimal set of tools to conduct stealthy scraping.
Stealthy Scraping Tools Do not use puppeteer and playwright for scraping. Explanation. We only use the CDP to obtain the page source and to get the ab
88 Jan 04, 2023
🤖 Threaded Scraper to get discord servers from disboard.org written in python3
Disboard-Scraper Threaded Scraper to get discord servers from disboard.org written in python3. Setup. One thread / tag If you whant to look for multip
11 Nov 01, 2022
An application that on a given url, crowls a web page and gets all words, sorts and counts them.
Web-Scrapping-1 An application that on a given url, crowls a web page and gets all words, sorts and counts them. Installation Using the package manage
1 Jan 16, 2022
A simple django-rest-framework api using web scraping
Apicell You can use this api to search in google, bing, pypi and subscene and get results Method : POST Parameter : query Example import request
url =
1 Dec 19, 2021
Get-web-images - A python code that get images from any site
image retrieval This is a python code to retrieve an image from the internet, a
1 Dec 30, 2021
哔哩哔哩爬取器:以个人为中心
Open Bilibili Crawer 哔哩哔哩是一个信息非常丰富的社交平台,我们基于此构造社交网络。在该网络中,节点包括用户(up主),以及视频、专栏等创作产物;关系包括:用户之间,包括关注关系(following/follower),回复关系(评论区),转发关系(对视频or动态转发);用户对创
3 Oct 21, 2021
a small library for extracting rich content from urls
A small library for extracting rich content from urls. what does it do? micawber supplies a few methods for retrieving rich metadata about a variety o
588 Dec 27, 2022
This repo has the source code for the crawler and data crawled from auto-data.net
This repo contains the source code for crawler and crawled data of cars specifications from autodata. The data has roughly 45k cars
5 Nov 22, 2022
A simple flask application to scrape gogoanime website.
gogoanime-api-flask A simple flask application to scrape gogoanime website. Used for demo and learning purposes only. How to use the API The base api
1 Oct 29, 2021
A low-code tool that generates python crawler code based on curl or url
KKBA Intruoduction A low-code tool that generates python crawler code based on curl or url Requirement Python = 3.6 Install pip install kkba Usage Co
8 Sep 20, 2021
京东茅台抢购最新优化版本,京东茅台秒杀,优化了茅台抢购进程队列
京东茅台抢购最新优化版本,京东茅台秒杀,优化了茅台抢购进程队列
129 Dec 14, 2022
A simple, configurable and expandable combined shop scraper to minimize the costs of ordering several items
combined-shop-scraper A simple, configurable and expandable combined shop scraper to minimize the costs of ordering several items. Features Define an
2 Dec 13, 2021
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
Parsel Parsel is a BSD-licensed Python library to extract and remove data from HTML and XML using XPath and CSS selectors, optionally combined with re
859 Dec 29, 2022
A Happy and lightweight Python Package that searches Google News RSS Feed and returns a usable JSON response and scrap complete article - No need to write scrappers for articles fetching anymore
GNews 🚩 A Happy and lightweight Python Package that searches Google News RSS Feed and returns a usable JSON response 🚩 As well as you can fetch full
273 Dec 31, 2022
Scrapes mcc-mnc.com and outputs 3 files with the data (JSON, CSV & XLSX)
mcc-mnc.com-webscraper Scrapes mcc-mnc.com and outputs 3 files with the data (JSON, CSV & XLSX) A Python script for web scraping mcc-mnc.com Link: mcc
1 Nov 07, 2021