There are a few independent scholars out there who are successful, but they are distinct minority. Mostly, independent scholars are not very good scholars, and if there is a pecking order, then they are at the bottom.
Yes. In my field, "independent scholar" usually equals "flake." Sorry. I said usually--there are exceptions, but not enough to overcome the impression--based on hard experience--that "independent scholars" or "consultants" (sort of the same thing in my field) are academic misfits. I am not saying this is the OP's situation, but it's a hard perception to overcome.
And, with a "couple of a articles" and a book manuscript, there's not much of a record here to build on. This sounds like a retirement gig, not a career.
And, if you'rein the humanities, God help you--or, perhaps, charity.