Generally, yes, anyone is welcome to attend a Baptist church service. Baptist churches are typically very open and welcoming to visitors, regardless of their background or beliefs. You don't need to be a Baptist or a Christian to attend a service.
However, keep in mind that Baptist churches are independent and autonomous. While the general sentiment is one of welcome, it's always a good idea to check the specific church's website or contact them directly if you have any specific questions or concerns.
In summary, you will most likely be welcome to attend a service.