I wrote a bash script to handle the .success files. The field separator is ascii character 255 (\xff)
If your a linux user like me, or have a bash setup like cygwin on your windows you can use this.
1. Copy all your .success files into a directory for processing. Mine was just ~/gsa/
2. put this script, gsa-success.sh, into the directory and make sure to chmod +x gsa-success.sh
3. run the script with ./gsa-success.sh
4. the script will create a directory for every category in the success files like Indexer, Forum, Trackback and so on.
5. the script then creates a file for every platform under that directory and puts the urls in those files.
6. You end up with a simple directory structure, and text file lists in each. There is a text file for every platform you have successful posts to.
After all of that you can delete the copy of your .success files. It removes exact duplicate lines from the files.
If your a linux user like me, or have a bash setup like cygwin on your windows you can use this.
1. Copy all your .success files into a directory for processing. Mine was just ~/gsa/
2. put this script, gsa-success.sh, into the directory and make sure to chmod +x gsa-success.sh
3. run the script with ./gsa-success.sh
4. the script will create a directory for every category in the success files like Indexer, Forum, Trackback and so on.
5. the script then creates a file for every platform under that directory and puts the urls in those files.
6. You end up with a simple directory structure, and text file lists in each. There is a text file for every platform you have successful posts to.
Code:
#!/bin/bash
for i in *.success;
do
while read foo;
do
theurl=`echo $foo | gawk 'BEGIN { FS = "\xFF" } ; {print $1}'`
theplatform=`echo $foo | gawk 'BEGIN { FS = "\xFF" } ; {print $3}'`
thecategory=`echo $foo | gawk 'BEGIN { FS = "\xFF" } ; {print $4}'`
mkdir -p "$thecategory" >>/dev/null
echo $theurl >> "$thecategory/$theplatform.log"
done < "$i"
done
tempfile="$(mktemp)"
find . -name *.log >$tempfile && while read bar;do awk ' !x[$0]++' "$bar" >"$bar.fixed" && mv "$bar.fixed" "$bar";done < $tempfile && rm $tempfile >>/dev/null
echo "Done"After all of that you can delete the copy of your .success files. It removes exact duplicate lines from the files.
