Ray had a long criminal record including burglary, armed robbery, and forgery, resulting in multiple prison sentences.

Over the years, Ray was repeatedly arrested and convicted for various crimes. Starting with burglary in 1949, he went on to commit armed robbery and forgery, earning prison terms in California, Missouri, and federal penitentiaries. He was known for his repeated escapes from prison and his use of multiple aliases. This criminal history paints a picture of a man deeply entangled in a life of crime, which ultimately led to his involvement in the assassination of Martin Luther King Jr.