Does the script make my website slower for the visitor?

Because the script is loaded asynchronous the page download speed will not be affected. It will have a very small impact when a visitor clicks on an outgoing link. When people click to a different website the impact of this is minimal compared to the actual page loading time.