@sam_uk wrote:

@syed @Abhishek I've been struggling to split the RSS html files into tiny bits, this is going to be a bigger problem. You don't want to read a manual or book in 30 parts..

If you are somehow able to specify which folder a file ends up in was thinking maybe you could set chip to run

$ for d in ./*/ ; do (cd "$d" && sh recombine.sh ); done

Every 5 mins or so

Then before sending you could

$md5sum espanol-26-1-2016.htm
$split -b 1000 espanol-26-1-2016.htm

Send the files including Md5sum >>>>>

And then send a recombine script as the final file.

---recombine.sh---

!/bin/sh

cat x* > espanol-26-1-2016.htm
md5sum espanol-26-1-2016.htm
if md5sum -c espanol-26-1-2016.htm.md5; then

rm -- "$0"

cp espanol-26-1-2016.htm > /final-location
rm -rf /path/to/directory/*

The MD5 sum matched

else

The MD5 sum didn't match

fi

There's almost certainly a better way of doing this, but some version of it would sort out larger files?

Posts: 19

Participants: 3

Read full topic