Fetch the details of assets hosted on AWS.

Last update: Dec 29, 2022

Overview

onaws

onaws is a simple tool to check if an IP/hostname belongs to the AWS IP space or not. It uses the AWS IP address ranges data published by AWS to perform the search.

The tool could be used for:

Continuous recon of assets
Gathering assets using a specific service (e.g. EC2)
Finding region information for S3 buckets
... etc.

Install

pip install onaws

Usage

Given an IP:

onaws 52.219.47.34

Given a hostname:

A domain or subdomain can be passed as input:

onaws example.com

You may also supply an S3 bucket hostname as input:

onaws dropbox.s3.amazonaws.com

List of hostnames

onaws accepts line-delimited hosts on STDIN. This is helpful if you want to pipe the output of other tools to onaws:

$ cat hosts.txt
uber.s3.amazonaws.com
aws.com
google.com


$ cat hosts.txt | onaws
{
    "uber.s3.amazonaws.com": {
        "is_aws_ip": true,
        "ip_address": "52.218.46.121",
        "service": "S3",
        "region": "eu-west-1",
        "matched_subnet": "52.218.0.0/17",
        "hostname": "uber.s3.amazonaws.com"
    },
    "aws.com": {
        "is_aws_ip": true,
        "ip_address": "52.84.13.117",
        "service": "CLOUDFRONT",
        "region": "GLOBAL",
        "matched_subnet": "52.84.0.0/15",
        "hostname": "aws.com"
    },
    "google.com": {
        "is_aws_ip": false
    }
}

Output

If the IP/hostname falls in the AWS IP range, onaws will return the service, region and other details in the output:

{
    "is_aws_ip": true,
    "ip_address": "52.218.196.155",
    "service": "S3",
    "region": "us-west-2",
    "matched_subnet": "52.218.128.0/17",
    "hostname": "flaws.cloud"
}

Contribution

I welcome contributions from the public. If you find something that could be improved, please file an Issue or send a PR :)

Credits

Thanks to @TomNomNom for suggesting the name.

Comments

Code refactor; input + output streaming (#1 and #2); better output

I refactor the code and introduce input + output streaming (closes #1 and closes #2), with the output being in JSONL format. The input streaming approach was taken from the PR by @havefish (#3)—good stuff!

Furthermore, I improve the output and make it list-input-friendly by showing the specified input. It now looks as follows:

opened by KarimPwnz 1
Cache ip ranges

Given the size of the AWS IP ranges file, this PR makes onaws cache it. The cache is updated when the etag header, which represents the MD5 checksum of the remote data, does not match the local data checksum.

The local cache is located at ~/.onaws/ip-ranges.json, and all functionality related to fetching the IP ranges has been moved to ipranges.py.

opened by KarimPwnz 0
ISSUE #1, ISSUE #2: streaming input and output
current changes stream the input, hence the processing should occur at constant memory

However, as the output is still being gathered in-memory, the memory consumption on large input still remains; to be solved in issue #2.

a optional parameter has been added -s that takes two values t: text or j: json

with this change the whole process should run at constant memory

Example Usage: cat file.txt | onaws -sj
opened by havefish 0
Line delimited Output
currently the output is dumped in a single JSON.

this approach won't work for a large input

also streaming the output won't be possible, to use the output the while thing has to be produced first.

the solution is line delimited JSON or plain text
opened by havefish 0
Added -i and -o parameters for input and output files

Quick and dirty solution to add input and output files to work in my pipeline. The changes should not break anything afaik, you can merge it if you like. Thank you for the code!

opened by kz0ltan 0

Releases(v1.0.3)

v1.0.3(Jul 4, 2021)

Source code(tar.gz)
Source code(zip)
v1.0.2(Jul 4, 2021)

Source code(tar.gz)
Source code(zip)
v1.0.1(Jul 4, 2021)

Source code(tar.gz)
Source code(zip)
v1.0(Jul 3, 2021)
Input/output streaming

Cached IP range data; fetched on-demand

Faster IP lookups

More practical examples

Source code(tar.gz)
Source code(zip)

Owner

Amal Murali

Hmm.

GitHub Repository https://github.com/amalmurali47/onaws

A Very Simple Telegram Files Rename Bot by @AbirHasan2005

Rename-Bot This is a very simple Telegram Files Rename Bot by @AbirHasan2005. Features Rename Videos, Files or Audios. Permanent Custom Thumbnail Supp

124 Dec 25, 2022

A taskbar clock for secondary taskbars on Windows 11

ElevenClock A taskbar clock for secondary taskbars on Windows 11. When microsoft's engineers were creating Windows 11, they forgot to add a clock on t

1.7k Jan 07, 2023

Amazon AWS Web Tool (view only)

Amazon AWS Web Tool (AAWT) discontinued Features Cloudfront (simple) EC2 (With Charts and Prices) EC2 Reserved EBS ELB (With Charts) Obs:. only classi

9 Nov 07, 2022

An API wrapper for discord; maintained and improved from discord.py

Fusion.py Documentation What is Fusion.py you might ask; Fusion.py is a Discord.py fork that has most of the good features from most of the big Discor

5 Apr 19, 2022

Bot SpaceCrypto - An automation (bot) to play the game SpaceCrypto, it automatically log in, send ships to fight, refresh the game, new map, etc

SpaceCrypto Bot [en-us] In order to change to english Readme version click here.

11 Sep 11, 2022

Get notifications in your Discord server of any software releases from Apple.

Apple Releases Get notifications in your Discord server of any software releases from Apple. Running To locally host your own instance, create a Disco

17 Oct 22, 2022

An API wrapper around Discord API.

NeoCord This project is work in progress not for production use. An asynchronous API wrapper around Discord API written in Python. Features Modern API

14 Jan 03, 2022

A code to match you with the perfect Taylor Swift song for your mood and relationship status.

taylorswift A package for matching your current mood and relationship status to a suitable Taylor Swift song. Requirements: Python 2 or 3, and the num

82 Dec 09, 2022

SimpleDCABot is a simple bot that buys crypto with a dollar-cost averaging strategy.

Simple Open Dollar Cost Averaging (DCA) Bot SimpleDCABot is a simple bot that buys crypto on a selected exchange at regular intervals for a prescribed

4 Mar 28, 2022

Ein Bot, der Dokumente bei Studydrive möglichst immer online hält

studydrive-altklausuren-bot Ein Bot, der Dokumente bei Studydrive möglichst immer online hält geplante Features: Multiaccount supprt: Es gibt mehrere

1 Jun 04, 2022

A small module to communicate with Triller's API

A small, UNOFFICIAL module to communicate with Triller's API. I plan to add more features/methods in the future.

1 Nov 01, 2022

Telegram vc userbot

Telegram Vc Userbot Available Commands /ping :- To check whether userbot is up or not /joinvc :- To join vc /leavevc :- To leave vc /join_group :- To

7 Nov 18, 2022

A really easy way to display your spotify listening status on spotify.

Spotify playing README A really easy way to display your spotify listening status on READMEs and Websites too! Demo Here's the embed from the site. Cu

21 Nov 06, 2022

The EscapePod Python SDK for Cyb3rVector's EscapePod Extension Proxy

EscapePod Extension SDK for Python by cyb3rdog This is the EscapePod Python SDK for Cyb3rVector's EscapePod Extension Proxy. With this SDK, you can: m

3 Mar 07, 2022

A discord webhook client written in Python.

DiscordWebhook A discord webhook client written in Python. Installation pip install webhook-client Example from webhook_client import WebhookClient, E

4 Nov 28, 2022

This is a free python bot program that crosses you to farm with auto click in space crypto NFT game, having fun :) Creator: Marlon Zanardi

🚀 Space Crypto auto click bot ready-to-use 🚀 This is a free python bot program that crosses you to farm with auto click in space crypto NFT game, ha

170 Dec 20, 2022

Fetch the details of assets hosted on AWS.

Related tags

Overview

onaws

Install

Usage

Given an IP:

Given a hostname:

List of hostnames

Output

Contribution

Credits

Comments

Code refactor; input + output streaming (#1 and #2); better output

Cache ip ranges

ISSUE #1, ISSUE #2: streaming input and output

Line delimited Output

Added -i and -o parameters for input and output files