A goal with the last kick of the first half turned the game on Celtic's heads when Simon Parke, possibly the best striker in the league, sent a screamer into the top corner.
Guiseley had enjoyed the majority of possession but it was Celtic who had the best chances and would have deserved their two-goal lead. They had a fantastic start when Steve Jones, recalled to replace the suspended Kevin Parr, latched onto a loose ball at the edge of the box and hit a cracking shot into the top corner.
More chances came and went but they all went begging before Celtic scored a second stunning goal. Eddie Johnston collected the ball in his own area and sprinted out of defence with it. He glided through the puddles and past defenders to the edge of the area, played a neat one-two with Steele and clipped a glorious shot past a startled James Shutt.
That should have been the platform for a much needed three points but Guiseley kept pressing and pulled one back on the stroke of half-time.
After the break, Celtic again looked comfortable. Andy Mason shot narrowly over, Karl Marginson hit one wide and Winfield Steele is just not having any luck in front of goal at the moment.
The equaliser came after a Celtic corner. The ball sailed into the hands of Shutt whose first-time punt found Parke on the edge of Celtic's area. He was being marked by Mark Ogley and Andy Scott, but he shrugged them both aside with ease and blasted a goal past the hapless Gary Ingham. Another two points dropped for Celtic but they are definitely improving away from home this season.