Scorers: Sula (44) and Brown (88)
Goals at the end of each half saw Stranraer slip to the bottom of the League Two table.
The Blues made two changes from the Station Park disappointment as Paul Woods and Finn Ecrepont made way in favour of the returning Sean McIntosh and Matty Grant.
Stirling came into the game on the back of a three-game losing run and it was a first half which suggested there would be little between the two sides.
A corner apiece in the opening 15 minutes was about the best both sides could muster.
Jacob Pazikas was called into action eight minutes before the break when he pushed an Adam Brown corner clear from under his own crossbar before most of the action came in the final few minutes of the first half.
Grant saw a free-kick deflected off target before Stirling Albion found the breakthrough with a free-kick of their own.
Brown put the ball in the box and Stranraer failed to clear their lines.
It broke to Erik Sula and the defender managed to fire the ball beyond the reach of the home goalkeeper.
Stranraer sought an immediate reply but Mark Russell’s drive over the bar was the best they could manage before Brown fired straight at Pazikas in first half stoppage time.
It was not until the hour mark that the hosts managed to create a clear cut chance.
A fine run from Sean McIntosh saw the ball break kindly to Max Guthrie in the box.
The striker netted his first-ever senior goal last weekend at Forfar Athletic but he could not get his shot away quickly enough on this occasion and the chance was gone.
Instead, the visitors came within a whisker of doubling their lead on 69 minutes.
Jack Harkness did well on the right and put a low cross into the box.
Dale Carrick flicked towards goal and the ball seemed to squirm under Pazikas but the goalkeeper recovered well to gather the ball on the line.
Arguably, Stranraer’s best chance would fall to Grant.
A long ball up the park was nodded back towards Derek Gaston by Harkness in the Stirling goal and Grant was just inches away from nipping in to poke the ball beyond the goalkeeper.
Instead, the game would be decided just a couple of minutes from time.
A free-kick just outside the Stranraer box was arrowed into the net by Brown and Stirling celebrated three valuable points.
The final game of the first quarter means a trip to Edinburgh City awaits Stranraer, who will have a third different manager in the dugout after Scott Robertson confirmed he would not be in charge.
Stranraer: Pazikas, Brindley, Cummins, Ross, McIntosh (Woods 84), Gallagher, Dunlop (Ecrepont 73), Russell (Edgar 64), Hawkshaw (Adam 72), Grant, Guthrie.
Not used: Robertson, McKnight and Broun.
Stirling Albion: Gaston, McGeachie, Sula, Dall, Harkness, Kerr, Ferguson (McKinley 72), Davidson, Brown, Knox (Graham 59), Carrick (Hilson 72).
Not used: Featherstone, Weir, Waugh, Milne and McIlvaney.
Referee: Alex Shepherd
Attendance: 435
HT: 0-1
Photos: Bill McCandlish