More on KentOnline
Jay May headed the only goal as Maidstone ended Hemel Hempstead's 100% start in National League South season on Tuesday night.
Stones put back-to-back home defeats behind them with May meeting Mitchell Pinnock's cross for the 50th-minute winner.
Hemel made a bright start on the back of three straight victories, going close when Jamie Slabber's header hit the post.
United grew into the match, with efforts from Pinnock and Alex Brown, and were on top by half-time.
With Stones in front, skipper Steve Watt sent a header on to the roof of the net and May threatened a second.
Bobby Joe-Taylor had a golden chance to put the game to bed after being found by Brown in the box but fired wide.
Hemel finished strongly but were denied an equaliser by Watt's superb block.
United's second away win moves them up to 11th place in the early table.
Maidstone: Worgan, Driver, Mills, Watt, Parry, Brown, Healy, Paxman (Bodkin 72mins), May, Akrofi (Johnson 78mins), Pinnock (Taylor 81mins). Subs not used: Coyle, Collin.
Attendance: 637.