Parity Logs – Understanding What Parity Logs Mean

Send Stderr And Stdout To A Log File

If you want to overwrite the log file each time you start your command:

parity [options] > /tmp/parity.log 2>&1

If you want to append to your log file each time you start your command:

parity [options] >> /tmp/parity.log 2>&1

Send Stderr And Stdout To Separate Log Files While Viewing Output

And if you want to log stderr and stdout into separate log files while viewing the output on your console:

parity [options] > >(tee stdout.log) 2> >(tee stderr.log >&2)

Reference How do I write stderr to a file while using “tee” with a pipe?.

If you want to create a script file to run this command, you will have to use #!/bin/bash (instead of #!/bin/sh) in the first line of the file as this redirection is bash specific:

#!/bin/bash

cd $HOME/Parity

parity [options] > >(tee stdout.log) 2> >(tee stderr.log >&2)

Save the above into $HOME/bin/runParity, chmod 700 $HOME/bin/runParity and your can then type runParity (or $HOME/bin/runParity) to start it.

Thanks for accepting the challenge of running a full archive node! :D

1) what are the drivers for the speed of the syncing in archive mode in parity ? Is that CPU ? Disk (hdd vs ssd) ? Memory (I also tried increasing the cache size to 4GB but it did not help) ? Network (i have a fast connection and it was sufficient until recently) ?

The main bottleneck is disk I/O. Followed by available memory for caching, followed by bandwidth, followed by CPU. But usually it breaks down to I/O issues. And since you are using a HDD, this is probably already your key issue. You can fine-tune your database by running --db-compaction hdd. In addition, you can increase your cache depending on your available memory to something huge like 4GB with --cache-size 4096 or even more, this might reduce some IO activity.

2) Could my move from ssd to hdd be the cause of this performance drop ? In the past i had no problem catching up so that's a new problem for me.

Yes, I fear you will have not much luck with syncing the archive on an HDD.

3) Alternatively does there exists things like "checkpoints" of the full chain which i could download directly from a trusted source (like parity tech themselves perhaps) ?

No :)

But you could get - if possible for you - hands on a fast machine with flash drives or fast SSDs and huge memory, do the full archive sync, and copy the DB to your HDD after completion.

4) Perhaps orthogonal to the question itself but what i need is the Events logs recorded by Smart Contracts when they are executed. Is it really necessary for me to keep the full states when i sync the chain in order to get those ?

Not sure if I can answer that question directly, but if you are looking at future events, you could simply warp-sync to the latest block and enable archive pruning mode for all future blocks.

5) assuming the issue is with the I/O of the drive. Is there a way for me to keep the bulk of the chain db on a slow drive (like external hdd) while using my ssd only for performing the syncing of recent blocks only (like the last 100000 would be enough for my purpose) ?

Not that I'm aware of. Please follow https://github.com/paritytech/parity/issues/6280 if possible.