The rejection notice mentioned
"following documents may be provided:
Your original I-130 ...
Your original I-360 ..
A copy of your Form I-797..."
It seems that they didn't consider it as follow to join case.
But our marriage date is 11/2005, my wife's priority date is 6/2003, and she got her green card approval notice 9/2007. I should qualify for follow to join.