Hint: Apply Newton's law of gravitation.
Consider the diagram below in which six point masses are Placed at six vertices A, B, C, D, E and F.
AC=AG+GC=2AG =2lcos30°=2l×√3/2 =√3l=AEAD=AH+HJ+JD =lsin30°+l+lsin 30°=2l
Step 1: Find the forces on any mass due to other masses.
Force on mass m at A due to mass m at B is, F1=Gmml2 along with AB.
Force on mass m at A due to mass m at C is, F2=Gm×m(√3l)2=Gm22l2 along with AC.
[∵ AC=√3l]
Force on mass m at A due to mass mat D is, F3=Gm×m(√2l)=Gm24l2 along with AD. [∵ AD=2l]
Force on mass m at A due to mass mat E is, F4=Gm×m(√3l)2=Gm23l2 along with AE.
Force on mass m at A due to mass m at F is, F5=Gm×ml2=Gm2l2 along with AF.
Step 2: Find the resultant force on mass m at A.
Resultant forces on mass m due to F1 and F5, F1' along with AD.
Angle between ]
along with AD.
So the net force along AD