Brownian motion of a Rayleigh particle confined in a channel: A generalized Langevin equation approach