It was tough luck on the Shielfield Park outfit who had held the lead since Darren Lavery’s eighth minute goal.
It came after a nice flick by Lee Currie put Ross Drummond in down the left. He drove into the box and laid on a perfect cross for Lavery to slot home his ninth of the season from close range.
Albion pressed forward in search of an equaliser and Gemmill fired home on the quarter hour mark only for his effort to be ruled offside.
McKenzie then showed good pace to cut in from the left but his shot was comfortably saved by Andrews.
The home side had the better of the play, however, and Paul Willis twice went close to extending their lead, first with a fierce effort tipped over by Parry and then with a shot from the edge of the box that almost sneaked in.
The visitors almost drew level on the half hour when a Davidson free kick was flicked towards goal by Michael Dunlop and clipped the top of the bar.
Lavery was looking dangerous and threatened to double his tally when a long ball over the top sent him clear only for good defending to see him crowded out.
He turned provider on 37 minutes when a clever pass played in Willis down the right and his low cross nearly found Dargo.
The homw side started the second half brightly but suffered a blow 10 minutes in when Laverty limped off with what looked like a hamstring injury.
The Coatbridge outfit pressed forward and Young was booked for pulling down the lively Mckenzie who got up to fire a 22-yard free kick over the bar.
Clear cut chances were few and far between, however, as Berwick defended resolutely. But an increasingly rearguard action was finally broken on 84 minutes when Michael Dunlop rose unmarked to head home a corner.
Gemmill almost snatched a last gasp winner for the visitors but his fierce shot from outside the area was tipped over.