If your controller is above the fridge, the distance between the controller and batteries exceed the distance for getting acceptable efficiency. Voltage drop occurs because of the length of the run.
I suggest mounting within 3 feet of your battery for best results.