Subdomain enumeration,Web scraping and finding usernames automation script written in python

Last update: Nov 22, 2022

Overview

𝓟𝓨𝓞𝓢𝓘𝓝𝓣

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Installation

git clone https://github.com/d8rkmind/Pyosint.git
cd PyOsint
pip3 install -r requirements.txt

Usage :

python3 Pyosint.py [OPTIONS]

Brief info:

The main functionality of this program has been divided to 3 parts

Find - Module to search For usenames form a list of 326 websites
Scrap - To Scrap a website to extract all links form a given website and store it in a file
Enum - To automate the search of subdomains of a given domain from different services

In Scrap module results are automatically stored in output/web folder wit he ip-address of the website as the filename

The services used are Virus Total,PassiveDns,CrtSearch,ThreatCrowd
Enum module an Api key of Virus total that you can get from going Here

Paste the key inside api.json file:

* if this step is not done Virus total may block your request

Command Line Utilization Information.

The following are the sub-commands that work this program

Arguments	Shot form	Long form	Functionality
Name	-n	--name	To specify the domain name or username to use
Module	-m	--module	To specify which module to use
Output	-o	--output	To specify outputfile name
Thread	-t	--threads	To specify the number of threads to use [ Not applicable to web crawling ]
Limit	-l	--limit	to specify the maxium value of web urls to crawl [ Applicable only to web crawling ]
Verbose	-v	--verbose	To enable verbose mode [ Applicable only to Enumeration ]
Ports	-p	--ports	To specify the ports to scan [ Applicable only to Enumeration ]
Help	-h	--help	To Show the help options

Example :

Linux commands:

python3 pyosint.py -m find -n exampleuser               <-- Username-huntdown

python3 pyosint.py -m scrap -n http://scanme.nmap.org   <-- Scrapping using bot

python3 pyosint.py -m enum -n google.com                <-- Subdomain enum

The project is still in development and will be added with additional functionality.
Happy to hear suggestions for improvement.

Special Thanks to 𝓣𝓮𝓬𝓱𝓷𝓸𝓻𝓮𝓬𝓴 and 𝓢𝓱𝓾𝓷𝓾𝔁 - 𝓢𝓽𝓾𝔁𝓷𝓮𝓽 for working in this project

Note :

This is only for educational and research purposes.The developers will not be held responsible for any harm caused by anyone who misuses the material.

License :

Pyosint is licensed under the GNU GPL license. take a look at the LICENSE for more information

Update informations

Update on 18-8-21:

Rewritten the code completely ,Improved interface

Update on 20-8-21:

Subdomain enumeration module (enum) has been added

Update on 23-8-21:

Find module code that has been optimised. The number of sites to automate has grown from 14 to 147, and connection error has been resolved.

Update on 16-09-21:

Program has been re-written to work with arguments
Find module has been added threading Functionality
Output functionality has been added to every module
More Error handiling has been added
Number of sites has been increased from 147 to 326
Cross platform portable
Reduced unused and unwanted codes
Removed console mode

You might also like...

NExfil is an OSINT tool written in python for finding profiles by username.

NExfil is an OSINT tool written in python for finding profiles by username. The provided usernames are checked on over 350 websites within few seconds.

1.4k Jan 1, 2023

Web Scraping com Python - Raspando Vagas para Programadores

Web Scraping com Python - Raspando Vagas para Programadores Sobre o Projeto Web

3 Dec 30, 2021

A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts

log4j-scan A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts Features Support for lists of URLs. Fuzzing for more

4 Aug 8, 2022

Vulnerability Scanner & Auto Exploiter You can use this tool to check the security by finding the vulnerability in your website or you can use this tool to Get Shells

About create a target list or select one target, scans then exploits, done! Vulnnr is a Vulnerability Scanner & Auto Exploiter You can use this tool t

108 Dec 4, 2021

SCodeScanner stands for Source Code scanner where the user can scans the source code for finding the Critical Vulnerabilities.

The SCodeScanner stands for Source Code Scanner, where you can scan your source code files like PHP and get identify the vulnerabilities inside it. The tool can use by Pentester, Developer to quickly identify the weakness.

136 Dec 13, 2022

IDAPatternSearch adds a capability of finding functions according to bit-patterns into the well-known IDA Pro disassembler based on Ghidra’s function patterns format.

IDA Pattern Search by Argus Cyber Security Ltd. The IDA Pattern Search plugin adds a capability of finding functions according to bit-patterns into th

48 Dec 29, 2022

A Burp Suite extension made to automate the process of finding reverse proxy path based SSRF.

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Related tags

Overview

𝓟𝓨𝓞𝓢𝓘𝓝𝓣

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Installation

Brief info:

Command Line Utilization Information.

Example :

Linux commands:

Note :

License :

Update informations

Update on 18-8-21:

Update on 20-8-21:

Update on 23-8-21:

Update on 16-09-21:

You might also like...

NExfil is an OSINT tool written in python for finding profiles by username.

Web Scraping com Python - Raspando Vagas para Programadores

A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts

Vulnerability Scanner & Auto Exploiter You can use this tool to check the security by finding the vulnerability in your website or you can use this tool to Get Shells

SCodeScanner stands for Source Code scanner where the user can scans the source code for finding the Critical Vulnerabilities.

IDAPatternSearch adds a capability of finding functions according to bit-patterns into the well-known IDA Pro disassembler based on Ghidra’s function patterns format.

A Burp Suite extension made to automate the process of finding reverse proxy path based SSRF.

A simple automatic tool for finding vulnerable log4j hosts

Tool for finding PHP source code vulnerabilities.

Releases(v1)

v1(Sep 16, 2021)

Owner

Syam

Cowrie SSH/Telnet Honeypot https://cowrie.readthedocs.io

com_media allowed paths that are not intended for image uploads to RCE

Um script simples de Port Scan + DNS by Hostname

pybotnet - A Python Library for building Botnet , Trojan or BackDoor for windows and linux with Telegram control panel

This is a simple PoC for the newly found Polkit error names PwnKit

Crypto Meta Extractor

Proof of concept GnuCash Webinterface

Analyse a forensic target (such as a directory) to find and report files found and not found from CIRCL hashlookup public service

Mips script decompiles MIPS assembly instructions & bot functionality

Proof of concept to check if hosts are vulnerable to CVE-2021-41773

BF-Hash - A Python Tool to decrypt hashes by brute force

Uncover the full name of a target on Linkedin.

Polkit - Local Privilege Escalation (CVE-2021-3560)

CTF framework and exploit development library

Linus-png.github.io - Versionsverwaltung & Open Source Hausaufgabe

An open-source post-exploitation framework for students, researchers and developers.

This repository detects a system vulnerable to CVE-2022-21907 and protects against this vulnerability if desired

Steal Files on a Windows Machine

Midas ELF64 Injector is a tool that will help you inject a C program from source code into an ELF64 binary.

A bitcoin private keys brute-forcing tool. Educational purpose only.