Single　pixel　three-dimensional　(3D)　imaging　technique　has　attracted　lots　of　attention　owing　to　its　potential　capability　of　working　in　a　wide　waveband.　In　this　work,　the　single　pixel　3D　imaging　is　realized　with　the　assistance　of　phase-shifting　fringe　projection.　The　deformed　fringe　images　are　recorded　with　the　passive　single　pixel　imaging　technique,　and　the　3D　information　of　the　object　is　calculated　with　the　phase　information　recovered　from　the　deformed　fringe　images.　The　accuracy　of　3D　reconstruction　is　guaranteed　with　well-designed　system　calibration.　The　validity　of　proposed　system　is　demonstrated　in　experiments.