The difference between a productive day at work and a busy day lies in one simple factor: control.

On days where you feel productive, it’s because you’re in control of your time and how you spent it. You executed on the tasks you needed to accomplish. On days that simply feel busy, and leave you feeling unproductive, however, it’s likely you’ve been handling distractions and last-minute tasks that prevent you from your main objectives.

“It’s too easy for last-minute requests, distractions, and fillers to take control of your time and to-do list, leaving little room for high-impact work,” writes Fran Hauser for The Muse. “But when you start to pay attention to these hidden time sucks, you can prioritize the things that matter most to you and your career.”

Here's a sample process of how to take back your time:

1. Review your tasks. To start, assess your tasks on any given day and consider what items are actually “distractors” or “fillers.”

“Distractors are tasks indirectly related to your work that prevent you from focusing on your priorities. They’re inevitable but not always proportionate...they become a problem when they take over your to-do list,” explains Hauser. Fillers, on the other hand, are task that are related to your work but not highly regarded or progressive in nature. Taking note of these tasks, like scheduling meetings, taking notes or being the organized member of your team can take more time and garner no recognition.

2. Make decisions. Now that you have your list of tasks that distract or fill your time, it’s time to evaluate those. Ask yourself:

• Does this support one of my personal or professional goals?
• Is this a fundamental part of my job description?
• Does this give me access to a valuable connection or a different part of the business?
• Does it bring me joy?

If you answer “Yes” to any of these questions, even one, then it can stay on your list. Everything else moves to a “to-don’t” list. But this too requires some thought.

“Some things you might be able to just stop doing. Others may require buy-in from your manager or delegation to someone else. For each item on your to-don’t list, add the first thing you need to do to get it off your plate,” writes Hauser.

3. Learn to say no, with kindness. Now that you have your list of fillers and distractors, and have determined what you need to stop doing – it’s time to keep those tasks from creeping back onto your plate.

“When one of those distractors or fillers pops ups, decline with confidence,” suggests Hausen. “If you’re feeling generous, you can always offer a different timeline or a smaller assist, such as sharing research on a smaller piece of a project that needs to be done. This keeps you focused on your goals while still coming across as a team player.”