Actually they can.

For eg. Some green card holders live overseas. They are required to visit here periodically to keep status alive.

I know of cases where their green cards were revoked