If you own a cat, you know it's nearly impossible to do anything on or near the floor without your cat developing a keen interest and deciding to join you in whatever it is you're trying to do. Exercise is no different.
If it bothers you to do exercises in tandem with cats, maybe there is a way to "purrsuade" them to develop other interests. Outsmarting Cats: How to Persuade the Felines in Your Life to Do What You Want by Wendy Christensen [636.8 CHR] may be the key! Honestly, I've never known a cat to do anything it doesn't want to do, so good luck!