Using HPU to unload data from source and transferring that data over sockets and using native LOAD to load the data. Also, partitioning is changing.
A simple script that counts the number of rows and rate at which the LOAD is going.
#!/bin/bash
prevRows=0
while true
do
rows=$(db2 list utilities show detail | grep -E 'Completed Work.*rows' | awk '{sum+=$4} END {print sum}')
start_time="$(date -u +%s)"
if [[ "$rows" == "" ]] ; then
echo "No rows. Exiting ..."
break;
else
rateRows="$(bc <<< "scale=2; ($rows-$prevRows)/5")"
printf "$(date +'%Y-%m-%d %H:%M:%S') Total Rows %'9.0f Rate %9.2f per seconds\n" \
$rows $rateRows
fi
sleep 5
end_time="$(date -u +%s)"
prevRows=$rows
done
A sample output:
[dbpemon@node0101-fab - dashDB hpu]$ ./monrows 2017-12-06 08:53:09 Total Rows 2,258,737,188 Rate 812133.20 per seconds 2017-12-06 08:53:15 Total Rows 2,263,078,727 Rate 868307.80 per seconds 2017-12-06 08:53:21 Total Rows 2,268,224,157 Rate 1029086.00 per seconds 2017-12-06 08:53:27 Total Rows 2,272,421,340 Rate 839436.60 per seconds 2017-12-06 08:53:33 Total Rows 2,277,457,985 Rate 1007329.00 per seconds 2017-12-06 08:53:39 Total Rows 2,281,807,463 Rate 869895.60 per seconds 2017-12-06 08:53:45 Total Rows 2,285,964,980 Rate 831503.40 per seconds