Fiji's World Cup debut drew attention ahead of the Bulikula's meeting with the PNG Orchids in Port Moresby next Saturday.
The newcomers pushed New Zealand, three-time World Cup winners, before losing 18-12 at McDonald Jones Stadium.
Fiji led 12-10 at halftime and held that advantage for another 20 minutes, until Zahara Temara's penalty levelled the score.
The Bulikula defended repeatedly on their own goal-line and attacked with ambition, but Leianne Tufunga scored the winning try with three minutes remaining.
Raecene McGregor's corner kick gave Tufunga the chance to gather and score in the right corner.
Fiji coach Jone Wesele said his team had made its mark against the second-ranked nation.
"It's truly amazing to see how relentless they were coming up against the second nation in the world - that's quite a statement," Wesele said.
"They made their mark today. The girls brought it to their doorstep. We are not here to make up the numbers."
New Zealand coach Ricky Henry called the match a wake-up call for a side featuring Georgia Hale, Mele Hufunga, McGregor and Apii Nicholls, each with at least 15 Tests.
"The good thing about it was that we found a way, but we've got some work to do," Henry said.
The Ferns travel home to host France in Christchurch next Sunday.