Secondery adfs configuration

Hello To all .

We have exchange Hybrid +office365 sso working with adfs  in our main site and its working ok - 

we need to create ADFS  redundency - 

we have deployed a loadbalncer in the cloud (Zenloadbalncer) with a Virtual IP 

 we added our main ADFS server (site A)  (public ip )

we added our secondery ADFS server (site B) (public ip)

we want to redirect all adfs Querys to the cloud virtual ip (loadbalancer)

my question is regarding ADFS in site B configuration - does ADFS in site B need to be configured as part of  main ADFS farm meaning join it to site a A  - or stand alone ? 

Thanks for the help .