Subdomain enumeration,Web scraping and finding usernames automation script written in python

Last update: Nov 22, 2022

Overview

𝓟𝓨𝓞𝓢𝓘𝓝𝓣

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Installation

git clone https://github.com/d8rkmind/Pyosint.git
cd PyOsint
pip3 install -r requirements.txt

Usage :

python3 Pyosint.py [OPTIONS]

Brief info:

The main functionality of this program has been divided to 3 parts

Find - Module to search For usenames form a list of 326 websites
Scrap - To Scrap a website to extract all links form a given website and store it in a file
Enum - To automate the search of subdomains of a given domain from different services

In Scrap module results are automatically stored in output/web folder wit he ip-address of the website as the filename

The services used are Virus Total,PassiveDns,CrtSearch,ThreatCrowd
Enum module an Api key of Virus total that you can get from going Here

Paste the key inside api.json file:

* if this step is not done Virus total may block your request

Command Line Utilization Information.

The following are the sub-commands that work this program

Arguments	Shot form	Long form	Functionality
Name	-n	--name	To specify the domain name or username to use
Module	-m	--module	To specify which module to use
Output	-o	--output	To specify outputfile name
Thread	-t	--threads	To specify the number of threads to use [ Not applicable to web crawling ]
Limit	-l	--limit	to specify the maxium value of web urls to crawl [ Applicable only to web crawling ]
Verbose	-v	--verbose	To enable verbose mode [ Applicable only to Enumeration ]
Ports	-p	--ports	To specify the ports to scan [ Applicable only to Enumeration ]
Help	-h	--help	To Show the help options

Example :

Linux commands:

python3 pyosint.py -m find -n exampleuser               <-- Username-huntdown

python3 pyosint.py -m scrap -n http://scanme.nmap.org   <-- Scrapping using bot

python3 pyosint.py -m enum -n google.com                <-- Subdomain enum

The project is still in development and will be added with additional functionality.
Happy to hear suggestions for improvement.

Special Thanks to 𝓣𝓮𝓬𝓱𝓷𝓸𝓻𝓮𝓬𝓴 and 𝓢𝓱𝓾𝓷𝓾𝔁 - 𝓢𝓽𝓾𝔁𝓷𝓮𝓽 for working in this project

Note :

This is only for educational and research purposes.The developers will not be held responsible for any harm caused by anyone who misuses the material.

License :

Pyosint is licensed under the GNU GPL license. take a look at the LICENSE for more information

Update informations

Update on 18-8-21:

Rewritten the code completely ,Improved interface

Update on 20-8-21:

Subdomain enumeration module (enum) has been added

Update on 23-8-21:

Find module code that has been optimised. The number of sites to automate has grown from 14 to 147, and connection error has been resolved.

Update on 16-09-21:

Program has been re-written to work with arguments
Find module has been added threading Functionality
Output functionality has been added to every module
More Error handiling has been added
Number of sites has been increased from 147 to 326
Cross platform portable
Reduced unused and unwanted codes
Removed console mode

You might also like...

NExfil is an OSINT tool written in python for finding profiles by username.

NExfil is an OSINT tool written in python for finding profiles by username. The provided usernames are checked on over 350 websites within few seconds.

1.4k Jan 1, 2023

Web Scraping com Python - Raspando Vagas para Programadores

Web Scraping com Python - Raspando Vagas para Programadores Sobre o Projeto Web

3 Dec 30, 2021

A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts

log4j-scan A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts Features Support for lists of URLs. Fuzzing for more

4 Aug 8, 2022

Vulnerability Scanner & Auto Exploiter You can use this tool to check the security by finding the vulnerability in your website or you can use this tool to Get Shells

About create a target list or select one target, scans then exploits, done! Vulnnr is a Vulnerability Scanner & Auto Exploiter You can use this tool t

108 Dec 4, 2021

SCodeScanner stands for Source Code scanner where the user can scans the source code for finding the Critical Vulnerabilities.

The SCodeScanner stands for Source Code Scanner, where you can scan your source code files like PHP and get identify the vulnerabilities inside it. The tool can use by Pentester, Developer to quickly identify the weakness.

136 Dec 13, 2022

IDAPatternSearch adds a capability of finding functions according to bit-patterns into the well-known IDA Pro disassembler based on Ghidra’s function patterns format.

IDA Pattern Search by Argus Cyber Security Ltd. The IDA Pattern Search plugin adds a capability of finding functions according to bit-patterns into th

48 Dec 29, 2022

A Burp Suite extension made to automate the process of finding reverse proxy path based SSRF.

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Related tags

Overview

𝓟𝓨𝓞𝓢𝓘𝓝𝓣

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Installation

Brief info:

Command Line Utilization Information.

Example :

Linux commands:

Note :

License :

Update informations

Update on 18-8-21:

Update on 20-8-21:

Update on 23-8-21:

Update on 16-09-21:

You might also like...

NExfil is an OSINT tool written in python for finding profiles by username.

Web Scraping com Python - Raspando Vagas para Programadores

A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts

Vulnerability Scanner & Auto Exploiter You can use this tool to check the security by finding the vulnerability in your website or you can use this tool to Get Shells

SCodeScanner stands for Source Code scanner where the user can scans the source code for finding the Critical Vulnerabilities.

IDAPatternSearch adds a capability of finding functions according to bit-patterns into the well-known IDA Pro disassembler based on Ghidra’s function patterns format.

A Burp Suite extension made to automate the process of finding reverse proxy path based SSRF.

A simple automatic tool for finding vulnerable log4j hosts

Tool for finding PHP source code vulnerabilities.

Releases(v1)

v1(Sep 16, 2021)

Owner

Syam

Chrome Post-Exploitation is a client-server Chrome exploit to remotely allow an attacker access to Chrome passwords, downloads, history, and more.

Salesforce Recon and Exploitation Toolkit

OLOP: One-Line & Obfuscated Python

Python low-interaction honeyclient

RedDrop is a quick and easy web server for capturing and processing encoded and encrypted payloads and tar archives.

Burp Suite extension for encoding/decoding EVM calldata

Exploiting CVE-2021-44228 in VMWare Horizon for remote code execution and more.

This little tool is to calculate a MurmurHash value of a favicon to hunt phishing websites on the Shodan platform.

Spring4Shell - Spring Core RCE - CVE-2022-22965

This tool allows to automatically test for Content Security Policy bypass payloads.

A CTF2.5/MMF2 Decompiler

A Proof-Of-Concept for the recently found CVE-2021-44228 vulnerability

Hubble is a modular, open-source security compliance framework. The project provides on-demand profile-based auditing, real-time security event notifications, alerting, and reporting. HubbleStack is a free and open source project made possible by Adobe. https://github.com/adobe

Northwave Log4j CVE-2021-44228 checker

These are Simple python scripts to test/scan your network

Password database With special stuff

Log4j-Scanner with Bind-Receipt and custom hostnames

A Feature Rich Modular Malware Configuration Extraction Utility for MalDuck

vulnerable APIs

A tool to brute force a gmail account. Use this tool to crack multiple accounts