Wordlist Manipulation
Hack Responsibly.
Always ensure you have explicit permission to access any computer system before using any of the techniques contained in these documents. You accept full responsibility for your actions by applying any knowledge gained here.
Wordlist Manipulation
Password file merge, sort by unique entries:
Sorts all files in a directory
Remove the space character with sed
# sed -i 's/ //g' file.txt
OR # egrep -v "^[[:space:]]*$" file.txt
Remove the last space character with sed
# sed -i s/.$// file.txt
Sorting Wordlists by Length
# awk '{print length, $0}' rockyou.txt | sort -n | cut -d " " -f2- > rockyou_length-list.txt
Convert uppercase to lowercase and the opposite
Remove blank lines with sed
Remove a specific character with sed
Delete all instances of a string with sed
Replace characters with tr
# tr '@' '#' < emails.txt
OR # sed 's/@/#' file.txt
Print specific columns with awk or cut
# awk -F "," '{print $3}' infile.csv > outfile.csv
OR # cut -d "," -f 3 infile.csv > outfile.csv
Note: if you want to isolate all columns after column 3 put a
-
(dash) after the number:# cut -d "," -f 3- infile.csv > outfile.csv
Generate Random Passwords with /dev/urandom
Remove Parenthesis with tr
# tr -d '()' < in_file > out_file
Generate wordlists from your file names
# ls -A | sed 's/regexp/& /g'
Process text files when cat is unable to handle strange characters
# sed 's/([[:alnum:]]*)[[:space:]]*(.)(..*)/12/' *.txt
Generate length based wordlists with awk
# awk 'length == 10' file.txt > 10-length.txt
Merge two different txt files
# paste -d' ' file1.txt file2.txt > new-file.txt
Faster sorting
# export alias sort='sort --parallel=<number_of_cpu_cores> -S <amount_of_memory>G ' && export LC_ALL='C' && cat file.txt | sort -u > new-file.txt
Mac to unix
# tr '\015' '\012' < in_file > out_file
Dos to Unix
# dos2unix file.txt
Unix to Dos
# unix2dos file.txt
Extract the difference between two files
# grep -F -v -f file1.txt -w file2.txt > file3.txt
Isolate specific line numbers with sed
# sed -n '1,100p' test.file > file.out
Create Wordlists from PDF files
# pdftotext file.pdf file.txt
Find the line number of a string inside a file
# awk '{ print NR, $0 }' file.txt | grep "string-to-grep"
Create your own Dictionaries
Find as much information about the target as you can and generate a custom dictionary. Tools that may help:
Crunch
Create a wordlist with lengths from 4 to 6 using a specified character set
Create a list of 4 character "words" using the character set mixalpha (inside file charset.lst)
Character set examples:
Using this you can make wordlists using custom character sets with shortcuts
Cewl
Generate a wordlist based on a target website
CUPP
Generate passwords based on your knowledge of the victim (names, significant dates, etc...)
Hashcat
TODO: add more
Rules
TODO: add more
If you like this content and would like to see more, please consider buying me a coffee!
Last updated