The lens on the X100T is sublime. Photos just look so damn good, way better than anything I've gotten out of my D7200 with the 35mm/50mm DX lenses. The photoprocessing is another massive benefit, the colours feel different to what I've gotten out of my Nikons. The film simulation modes are great, and I seem to get a lot of more shots you can use straight from the JPEGs without having to go through Lightroom. My favourite is the high-contrast black and white mode which is perfect for typical overcast days you get here.
Stuff like that just makes the camera really fun to use. The OVF/EVF hybrid is works well, although I'm almost always in EVF as there is hardly any lag with the X100T. The aperture control is also very satisfying. My only problem with the controls is it would be great if there was a control for the ISO and the buttons don't really feel all that robust.
The main negative is the fixed lens, which it seems won't be a huge issue if you're happy with 35mm. The converter lenses are worth getting as well - especially the 50mm if you want to do street photography. It does add a bit of bulk to the setup but it does give you a bit of extra versatility.
The other disadvantage compared to a DSLR is battery life - especially if you are using the EVF and the autofocus I don't believe touches even basic DSLRs in terms of speed.
I went through a phase after getting the X100T where I was taking it to work every day and just walking around after and taking photos. I would never have done that with the SLR, but the compactness of the X100T (compact enough to carry around while still big enough to use comfortably) makes it really convenient. If you slap on a clear filter and a lens hood you don't even need a lens cap.
I can't decide which I prefer. I took my X100T to New Zealand, and D7200 to Mongolia and on my last few trips I have taken both and alternated. I'm going to have a look through the recent photos and see which I prefer. Regardless of the output, I just enjoyed using the X100T a hell of a lot more, and I feel like in my recent trips I have improved with adapting to the limited focal length and compromising with different angles. I'm too invested in Nikon, but the XT1 would be my camera of choice going forward if looking for a whole system.
Also the D3300/35mm/18-55mm combo is cheap enough for you to jump back into at some point if you feel the need to go back to a full camera system.