Berwick made it seven league games without a win when they went down 2-1 away to Albion Rovers at Coatbridge.
The defeat means Rangers have now only taken four points out of a possible 21, and as a result they have dropped to eighth place in the Scottish Division 2 table, three points behind the fourth-placed play-off place.
After a disappointing run of results, Berwick rang the changes with Jonny Fairbairn, player-manager Colin Cameron, Dean Horribine and Paul Willis all handed starts.
Lee Currie shot from outside the box after just a minute’s play, but it was an easy take for Neil Parry.
After ten minutes Scott Chaplain got a shot in at the other end from inside the box, but Billy Bald was on hand to save.
As Berwick tried to force the tempo of the game Currie and then Darren Lavery both pulled shots wide, but Albion also looked dangerous and John Gemmell had a shot, which looked to be heading for the top corner, saved by Bald with Chaplain shooting over all inside the first half hour.
But the chances dried up after this and at half-time the teams turned around at 0-0.
The second half was only two minutes old when Albion made the breakthrough, Darren Young finding the net from outside the box after being set up by Mark McGuigan.
Bald made another good save from Gemmell to deny Albion, who continued to apply the pressure with a series of corners.
Ross Gray went close with a shot from outside the box as Berwick tried to force their way back into the match.and Craig Dargo was introduced up front to replace Horribine.
Rangers eventually hauled themselves back on level terms after 71 minutes when Lavery netted with a bullet header past Parry from a cross by Willis.
But just six minutes later the home side re-established their lead when Gemmell scored from a free kick.
With the game slipping away from them Lee Currie tried an audacious shot from all of 35 yards, but the effort went wide, before Gray saw a shot saved by Parry in the 88th minute.
Albion: Parry, Reid, R Dunlop, M Dunlop, Turnbull, McKenzie, Young, Chaplain (Mullin 68), Phillips, McGuigan, Gemmell
Berwick: Bald, Fairbairn, Young, Tulloch, Jacobs (Gold 87), Gray, Cameron (P Currie 75), L Currie, Horribine (Dargo 63), Lavery, Willis
Referee: David Munro.