Should VitalPBX Connect download phonebook from the PBX? 

Yes, it is possible! 

We recommend the following blog that shows how to configure VitalPBX Connect step by step. 

https://vitalpbx.com/blog/how-to-easily-set-up-your-vitalpbx-connect/