Working full time is definitely the biggest impediment to progress. I recently met someone who said he did 6 hours a day on his study even when he worked full time. He did say that it had put a strain on his family life.
Could / would you do this? It is dedicated but I think it is a bit weird to research your family history or one name whilst alienating your own living breathing relatives. Just an opinion but genealogy is a bit of an addiction so I can see how it would happen.