One of the most popular, Zoho CRM has had that from the beginning. Pipedrive has it as well. Often CRMs call the IMAP feature "email sync" so the CIO at the customer doesn't go nuts about working around Outlook.
That is really a feature of your email provider. I've used gmail and an old style shared server email, and in both cases, spam was filtered by the email provider.