Moore's outing had an inauspicious beginning when he hit Pirates leadoff batter Starling Marte, then walked Jordy Mercer.
Russell Martin singled home Marte before Brandon Guyer missed Pedro Alvarez's drive to right field, allowing Mercer to score. Gaby Sanchez added a two-run double while Jose Tabata and Marte added RBI singles to give the Pirates a 6-0 cushion.
Sam Runion took over for Moore after Marte's single and retired Mercer on a groundout to end the inning.
Moore allowed six runs -- four earned -- on five hits and a walk. He threw 41 pitches, 25 for for strikes.
"We're in a very unique situation where we're in Spring Training," Moore said. "These games don't go on our record. ... If I'm not going to get out of the first inning, I want it to be here."
Martin hit his third home run of the spring in the fourth when he crushed a three-run shot to center off Rays closer Grant Balfour. Martin's blast put the Pirates up, 9-1.
Martin has six hits in his last 10 at-bats. Last spring, the catcher had six hits in his first 40 at-bats during Spring Training. He had four RBIs Saturday after collecting just three last spring.
Francisco Liriano started for the Pirates and surrendered a run in the first, when Logan Forsythe tripled to lead off the inning and scored on James Loney's sacrifice fly.
Jerry Sands hit a two-run homer in the eighth inning for the Rays, and he drove in a run in a two-run ninth.
Up next:Chris Archer will make his second start of the spring on Sunday, when the Rays travel to Tampa to play the Yankees in a 1:05 p.m. ET contest, live on MLB.TV. Right-hander Josh Lueke is also scheduled to see action. Right-hander David Phelps is scheduled to start for the Yankees.