Fun with GlusterFS

Fun with GlusterFS

Creating this site has been a learning excersise for me. I'm self-hosting it on a server in my living room closet. The idea was to try to create a production ready site with all open source or free software.

So far the plan is to just do testing on my self-hosted setup and later be able to move it to a cloud provider like AWS or Azure or Google if I start getting too much traffic on my internet link or server.

With that in mind I'm trying to setup a GlusterFS geographic replication so that a standby server in AWS can be ready to go when the time comes.

For now though I've hit a speed bump and Gluster is failing to create the geo replicated volume with this strange error. I'm running this command on the master node: sudo gluster volume geo-replication georepvol [email protected]::georepslave create

[2018-04-27 03:44:40.140237] E [MSGID: 106336] [glusterd-geo-rep.c:5230:glusterd_op_sys_exec] 0-management: Unable to end. Error : Success
[2018-04-27 03:44:40.140288] E [MSGID: 106123] [glusterd-syncop.c:1482:gd_commit_op_phase] 0-management: Commit of operation 'Volume Execute system commands' failed on localhost : Unable to end. Error : Success
[2018-04-27 13:29:42.190202] E [MSGID: 106336] [glusterd-geo-rep.c:5230:glusterd_op_sys_exec] 0-management: Unable to end. Error : Success
[2018-04-27 13:29:42.190302] E [MSGID: 106123] [glusterd-syncop.c:1482:gd_commit_op_phase] 0-management: Commit of operation 'Volume Execute system commands' failed on localhost : Unable to end. Error : Success
[2018-04-27 13:40:02.167234] E [MSGID: 106316] [glusterd-geo-rep.c:2751:glusterd_verify_slave] 0-management: Not a valid slave
[2018-04-27 13:40:02.167546] E [MSGID: 106316] [glusterd-geo-rep.c:3139:glusterd_op_stage_gsync_create] 0-management: [email protected]::georepslave is not a valid slave volume. Error: Unable to fetch master volume details. Please check the master cluster and master volume.
[2018-04-27 13:40:02.167588] E [MSGID: 106301] [glusterd-syncop.c:1352:gd_stage_op_phase] 0-management: Staging of operation 'Volume Geo-replication Create' failed on localhost : Unable to fetch master volume details. Please check the master cluster and master volume.

This may be one of my new favorite error messages: "Unable to end. Error : Success".

One instersting tidbit is I had to manualy create the password-less SSH for root because the Gluster command gluster-georep-sshkey generate failed with a very similar error returned from a python script.

I'm using GlusterFS 3.13.0. I'm thinking I need to review all of the prerequisite software versions again...