If something affects your health negatively, logically it does affect your spiritual progress and well-being. Stop the addiction as fast as possible; any addiction that gathers roots in your mind and body must be dealt with as early as one recognizes this. Slight addiction in your case can be ceased instantly.
I don't know how true it is, but I read on a book that smoking closes your spiritual senses so much that mediums and spiritual people back then used to smoke a cigarette when some unwanted entity was disturbing them and/or they wanted to get their mind off the spiritual world.
Smoking also has an horrible impact on the pineal gland if I remember correctly.
Yes, smoking tobacco has a negative effect, but primarily harms your physical health.
Since smoking tobacco is a bad habit, you actually have a bad habit that can interfere with your spiritual development and that you need to get rid of in order to develop effectively.