Substitute David Gold grabbed a late winner as Berwick bounced back from their opening day league defeat with a hard-fought but deserved away win over East Fife.
Rangers led 2-0 at half-time with a goal from Paul Currie and an own goal from Allan Walker.
But East Fife hit back to level things up at 2-2 in the second half, with Berwick substitute David Gold netting the winner in the 89th minute.
Berwick made all the running in the first 45 and Scott Maxwell had a header saved by goalkeeper Alan Fleming after just a minute’s play.
Darren Lavery then had a header which went inches wide, before Lee Currie saw Fleming make two saves, one to his left and the other to his right.
As Rangers continued to press, Dean Hoskins was unlucky when he saw a header come back off the crossbar, and Currie went close again with a shot from outside the box which was high and wide.
Fleming was called into action again to deny Paul Willis with an angled shot, but he was finally beaten after 36 minutes when Paul Currie fired in a shot from outside the box after being set up by Willis.
And six minutes later Berwick opened up a 2-0 lead before half-time when Walker directed the ball into his own net with a diving header from a Lee Currie free kick.
At the start of the second half Berwick were forced to bring on Ben Miller in pace of Paul Currie, who took a knock.
And they suffered a further set-back when Jonny Fairbairn conceded a penalty and Alan Cook pulled a goal back for the home side from the spot after 56 minutes.
Maxwell forced Fleming into making another save from a shot, whilst at the other end Billy Bald had to rush off his line to make a good save as the home side went on the attack.
Lee Currie shot wide as Berwick tried to extend their advantage, but it was East Fife who drew level after 77 minutes when a free kick from Steven Campbell looped over the head of Bald.
But it was Berwick who had the last word when Gold struck the winner with his first goal for the club, netting in the 89th minute after taking a pass from. a Lee Currie free kick.
East Fife: Fleming, Mullen, Steven Campbell,Moyes,Scott Smith, Beaton (Barr 47), McAleer (Brown 88),Walker,Cook, McShane (Ross Campbell 72),Austin. Subs Not Used: A Trialist, Maskrey.
Booked: Beaton, Walker.
Goals: Cook 56 pen,Steven Campbell 77.
Berwick Rangers: Bald, Jacobs, Fairburn, Tulloch, Hoskins, Willis (Cameron 70),Notman (Gold 81),Paul Currie (Miller 47), Maxwell,Lee Currie, Lavery. Subs Not Used: Horribine, Andrews, Russell.
Goals: Paul Currie 37, Walker 43 og, Gold 89.
Referee: Colin Steven