Ruger 22/45 SSH

Is it difficult to change out the factory grip panels to aftermarket panels for something like LOK grip panels or hogue?