When using the machine executor, RVM is available for easy installation and use of custom ruby versions.
To get this going, add a step like the following:
name: Set ruby version to 2.3.4
rvm install 2.3.4
echo . $(rvm 2.3.4 do rvm env --path) >> $BASH_ENV
After this step runs, the new ruby version will be in place.