Hi- I moved the rebuild task from daily to weekly.
(read up on cron if this is unfamiliar to you)
The default time to run is 4am- if you can move it earlier, it might finish earlier. I've moved the rebuild to 22:00 on Friday night- so long as it is done by Monday its OK for this server.
I've also installed more RAM in the server to improve performance.