Have you ever done somthing? -> Yes -if you did. Have you ever N

Have you ever done somthing? -> Yes -if you did. No - if you never done something.

Have you ever NOT done something ->Yes - if you did NOT done something ; No - if you did done something. 

So, for the question, NO means you did not failed to file tax return after you have your green card (否定 NOT filed a tax return = you filed a tax return.)