Fetch the details of assets hosted on AWS.

Last update: Dec 29, 2022

Overview

onaws

onaws is a simple tool to check if an IP/hostname belongs to the AWS IP space or not. It uses the AWS IP address ranges data published by AWS to perform the search.

The tool could be used for:

Continuous recon of assets
Gathering assets using a specific service (e.g. EC2)
Finding region information for S3 buckets
... etc.

Install

pip install onaws

Usage

Given an IP:

onaws 52.219.47.34

Given a hostname:

A domain or subdomain can be passed as input:

onaws example.com

You may also supply an S3 bucket hostname as input:

onaws dropbox.s3.amazonaws.com

List of hostnames

onaws accepts line-delimited hosts on STDIN. This is helpful if you want to pipe the output of other tools to onaws:

$ cat hosts.txt
uber.s3.amazonaws.com
aws.com
google.com


$ cat hosts.txt | onaws
{
    "uber.s3.amazonaws.com": {
        "is_aws_ip": true,
        "ip_address": "52.218.46.121",
        "service": "S3",
        "region": "eu-west-1",
        "matched_subnet": "52.218.0.0/17",
        "hostname": "uber.s3.amazonaws.com"
    },
    "aws.com": {
        "is_aws_ip": true,
        "ip_address": "52.84.13.117",
        "service": "CLOUDFRONT",
        "region": "GLOBAL",
        "matched_subnet": "52.84.0.0/15",
        "hostname": "aws.com"
    },
    "google.com": {
        "is_aws_ip": false
    }
}

Output

If the IP/hostname falls in the AWS IP range, onaws will return the service, region and other details in the output:

{
    "is_aws_ip": true,
    "ip_address": "52.218.196.155",
    "service": "S3",
    "region": "us-west-2",
    "matched_subnet": "52.218.128.0/17",
    "hostname": "flaws.cloud"
}

Contribution

I welcome contributions from the public. If you find something that could be improved, please file an Issue or send a PR :)

Credits

Thanks to @TomNomNom for suggesting the name.

Comments

Code refactor; input + output streaming (#1 and #2); better output

I refactor the code and introduce input + output streaming (closes #1 and closes #2), with the output being in JSONL format. The input streaming approach was taken from the PR by @havefish (#3)—good stuff!

Furthermore, I improve the output and make it list-input-friendly by showing the specified input. It now looks as follows:

opened by KarimPwnz 1
Cache ip ranges

Given the size of the AWS IP ranges file, this PR makes onaws cache it. The cache is updated when the etag header, which represents the MD5 checksum of the remote data, does not match the local data checksum.

The local cache is located at ~/.onaws/ip-ranges.json, and all functionality related to fetching the IP ranges has been moved to ipranges.py.

opened by KarimPwnz 0
ISSUE #1, ISSUE #2: streaming input and output
current changes stream the input, hence the processing should occur at constant memory

However, as the output is still being gathered in-memory, the memory consumption on large input still remains; to be solved in issue #2.

a optional parameter has been added -s that takes two values t: text or j: json

with this change the whole process should run at constant memory

Example Usage: cat file.txt | onaws -sj
opened by havefish 0
Line delimited Output
currently the output is dumped in a single JSON.

this approach won't work for a large input

also streaming the output won't be possible, to use the output the while thing has to be produced first.

the solution is line delimited JSON or plain text
opened by havefish 0
Added -i and -o parameters for input and output files

Quick and dirty solution to add input and output files to work in my pipeline. The changes should not break anything afaik, you can merge it if you like. Thank you for the code!

opened by kz0ltan 0

Releases(v1.0.3)

v1.0.3(Jul 4, 2021)

Source code(tar.gz)
Source code(zip)
v1.0.2(Jul 4, 2021)

Source code(tar.gz)
Source code(zip)
v1.0.1(Jul 4, 2021)

Source code(tar.gz)
Source code(zip)
v1.0(Jul 3, 2021)
Input/output streaming

Cached IP range data; fetched on-demand

Faster IP lookups

More practical examples

Source code(tar.gz)
Source code(zip)

Owner

Amal Murali

Hmm.

GitHub Repository https://github.com/amalmurali47/onaws

Using AWS Batch jobs to bulk copy/sync files in S3

14 Sep 19, 2022

Aggrokatz is an aggressor plugin extension for Cobalt Strike which enables pypykatz to interface with the beacons remotely and allows it to parse LSASS dump files and registry hive files to extract credentials and other secrets stored without downloading the file and without uploading any suspicious code to the beacon.

aggrokatz What is this aggrokatz is an Aggressor plugin extension for CobaltStrike which enables pypykatz to interface with the beacons remotely. The

148 Dec 09, 2022

RP2 is a privacy-focused, free, open-source US cryptocurrency tax calculator

Privacy-focused, free, open-source cryptocurrency US tax calculator, up to date for 2021: it handles multiple coins/exchanges and computes long/short-term capital gains, cost bases, in/out lot relati

123 Jan 04, 2023

Super simple anti-spam Discord bot

AutoAntiRaidBot Super simple anti-spam Discord bot. Will automatically kick any member with an account made under 1 day ago, and will ban any member w

6 Jun 27, 2022

Raphtory-client - The python client for the Raphtory project

Raphtory Client This is the python client for the Raphtory project Install via p

5 Apr 28, 2022

IACR Events Scraper

IACR Events Scraper This scrapes https://iacr.org/events/ and exports it as a calendar file. I host a version of this for myself under https://arrrr.c

6 May 28, 2022

Create a roles overview page for all Ansible roles/playbooks in Gitlab

ansible-create-roles-overview Overview The script ./create_roles_overview.py queries a Gitlab API for Ansible roles and playbooks. It will iterate ove

2 Oct 11, 2021

WebhookHub - A discord WebHook Manager with much more features coming soon

WebhookHub A discord WebHook Manager with much more features coming soon This is

5 Feb 19, 2022

Telegram bot to extract text from image

OCR Bot @Image_To_Text_OCR_Bot A star ⭐ from you means a lot to us! Telegram bot to extract text from image Usage Deploy to Heroku Tap on above button

25 Nov 24, 2022

The first open-source PyTgCalls-based project.

SU Music Player — The first open-source PyTgCalls based Pyrogram bot to play music in voice chats Requirements FFmpeg NodeJS 15+ Python 3.7+ Deploymen

74 Nov 19, 2022

HTTP API for TON (The Open Network)

HTTP API for The Open Network Since TON nodes uses its own ADNL binary transport protocol, a intermediate service is needed for an HTTP connection. TO

66 Dec 28, 2022

Free and Open Source Channel/Group Voice chat music player for telegram ❤️ with button support Heroku Commands

ZeusMusic Requirements 📝 FFmpeg NodeJS nodesource.com Python 3.7 or higher PyTgCalls MongoDB 2nd Telegram Account (needed for userbot) 🧪 Get SESSION

4 Jan 03, 2022

Most Powerful Chatbot On Telegram Bot

About Hello, I am Lycia [リュキア], An Intelligent ChatBot. If You Are Feeling Lonely, You can Always Come to me and Chat With Me! How To Host The easiest

8 May 26, 2021

Backend.AI Client Library for Python

Backend.AI Client The official API client library for Backend.AI Usage (KeyPair mode) You should set the access key and secret key as environment vari

10 Feb 10, 2022

A Advanced Powerful, Smart And Intelligent Group Management Bot With New And Powerful Features

Vegeta Robot A Advanced Powerful, Smart And Intelligent Group Management Bot With New And Powerful Features ... Written with Pyrogram and Telethon...

9 Nov 16, 2022

This is a simple bot that can be used to upload images to a third-party cloud (image hosting). Currently, only the imgbb.com website supports the bot. I Will do future updates

TGImageHosting This is a simple bot that can be used to upload images to a third party cloud (image hosting). Currently, only the imgbb.com website su

0 Dec 26, 2021

Fetch the details of assets hosted on AWS.

Related tags

Overview

onaws

Install

Usage

Given an IP:

Given a hostname:

List of hostnames

Output

Contribution

Credits

Comments

Code refactor; input + output streaming (#1 and #2); better output

Cache ip ranges

ISSUE #1, ISSUE #2: streaming input and output

Line delimited Output

Added -i and -o parameters for input and output files

Releases(v1.0.3)

v1.0.3(Jul 4, 2021)

v1.0.2(Jul 4, 2021)

v1.0.1(Jul 4, 2021)

v1.0(Jul 3, 2021)