Absolutely. Most of us have spent the better part of a lifetime allowing our attention to wander freely. This habitual wandering becomes apparent when we first start to bring some intention to awareness. This is not a problem.
The mind will wander and when you realize that it has wandered, you pat yourself on the back for noticing the wandering and then bring your attention gently back to your object of focus, whatever it might be at the time. If judging thoughts arise (“I can’t do this! I am terrible at this. This isn’t for me.” etc.) you simply ignore them and let them pass away.
One of the skills we are trying to develop with meditation practice is concentration power. Each time the mind wanders and you bring it back, your concentration power gets a little stronger. As with weight training where each repetition of the movement makes your muscles a little stronger, with meditation each time the mind wanders and you bring it back to focus, your concentration power gets a little stronger.