Sculpt to Hand-painted workflow ONCE AND FOR ALL!!!
interpolator
Heya!
I've been struggling with this workflow for ages, going from a high-poly sculpt and ending up with what looks like a hand-painted texture. Biggest inspirations being Faf and Orb.
So this thread is basically me trying to figure this shit out once and for all. My prior attempts all ended up with me just hand-painting over 90% of the bakes. There simply has to be a better way than that!
Latest failed try : http://polycount.com/discussion/152423/iron-horde-handpainted-banner/p1
I've read the Vertex magazines over and over, seen a bunch of breakdowns from Blubber Busters, Pior and PixelB on how to composite the bakes etc, but something just isn't turning out right.
I guess there's no getting around having to have a good sculpt to begin with, but here's what I'm using for this exercise. I shamelessly ripped the idea of the metal greentooth + rock floor from PixelB.
I'd like to avoid using MatCaps in order to be able to replicate the results on a baked mesh and not be limited to tileable textures with the workflow. I'd also like to introduce painting onto the texture as late into the process as possible.
Any help on the subject would be greatly appreciated, I've been pulling my hair out for so long!
If anyone wants to have a go at compositing these maps it would be awesome, I'll upload the original maps if needed.
EDIT : Attached new files to this post.
I've been struggling with this workflow for ages, going from a high-poly sculpt and ending up with what looks like a hand-painted texture. Biggest inspirations being Faf and Orb.
So this thread is basically me trying to figure this shit out once and for all. My prior attempts all ended up with me just hand-painting over 90% of the bakes. There simply has to be a better way than that!
Latest failed try : http://polycount.com/discussion/152423/iron-horde-handpainted-banner/p1
I've read the Vertex magazines over and over, seen a bunch of breakdowns from Blubber Busters, Pior and PixelB on how to composite the bakes etc, but something just isn't turning out right.
I guess there's no getting around having to have a good sculpt to begin with, but here's what I'm using for this exercise. I shamelessly ripped the idea of the metal greentooth + rock floor from PixelB.
I'd like to avoid using MatCaps in order to be able to replicate the results on a baked mesh and not be limited to tileable textures with the workflow. I'd also like to introduce painting onto the texture as late into the process as possible.
Any help on the subject would be greatly appreciated, I've been pulling my hair out for so long!
If anyone wants to have a go at compositing these maps it would be awesome, I'll upload the original maps if needed.
EDIT : Attached new files to this post.
Replies
Hadn't thought of that but it's a good point. Still, you can sort of bake matcaps to models. Pior does it with his dota stuff and I do it sometimes to get metallic reflections on tricky surfaces.
I uploaded the maps! I also threw in a heightmap for good measure, aswell as a seperate download for the .psd incase anyone wants to see how bad I am at organizing those!
Just a few things i noticed from your initial attempt, the cavity map you where using wasn't doing the texture much justice, so i ran your normal through nDo and got a diffuse map, and replaced your cavity with that.
Then really all i did was bump the values in your gradient maps, then did a little bit of adjustment layers and finally a really crumy hand-paint pass (my wacom driver isn't working so i don't have pressure sensitivity, so i made do with what i could) Not sure if this is going to help you at all, but here's the PSD if you wanna have a gander: https://drive.google.com/file/d/0BzSs96v1FEPFNDZkcG5KUzZfTzQ/view?usp=sharing
But the way I bake matcaps is different still. I'll post something on it later tonight.
@FWAP : Thanks for joining me on this quest! I deliberately turned down the cavity alot, I don't think it looks very handpainted to have strong cavity. Unless it's for material definition on metallic surfaces maybe.
@Pixelb : That's the one! I'll have to take a look at that, maybe learn how to do proper MatCaps aswell.. I'm looking forward to see what you do with the maps!
I can't but start feeling that maybe the sculpt is the problem. No matter how I twist and turn it looks very sculpty in the end.
I started from scratch and gave it another go. Here's something I found out about how to composite the top/side light from the normal map.
If I use a group with Soft Light, and use a 50% black Lighten layer to remove the dark parts of the map it helps alot. Here's a picture of the old vs the new way of doing topdown lighting.
Maybe it would be helpful to take a handpainted rock/metal texture and try to replicate its values 1 to 1.
I think this'll turn out to be fun thread. Hope people like fanny will find this thread some day XD. This texturing thing is one of the hardest things (I found) to find.
Happy texture painting!!
So. Here's how I bake my matcaps.
I set up the scene in Blender with my lowpoly model with the settings below. I assign it an unlit material and add the normal map to the material. Then I add the mapcap sphere as a second texture and set it so it's mapped to "normals". I rotate the model so it's facing upwards, and then I bake a full render from it. No high-poly required!
The material setup:
Note, this only works for models that have a distinct "front" side to them. However you could, if you were feeling ambitious, bake matcap projections from several angles and composite them in photoshop.
This method also can also work to produce bakes similar to what's described in the link from @VanLogan. You would just apply the material to a flat plane instead of the lowpoly model. I tried it out, but the results are a lot mushier.
Still works great for tiling textures though. Check it out!
( P.S. I have no idea how to do this in Max/Maya, so don't ask.)
@PixelB : Wow, that looks really cool! No idea how to do that in Maya either, haha. How did you get the matcap into Blender? Or does blender use a similar system to Zbrush when it comes to matcaps?
If anything I think I'll try using some matcaps from screengrabs in Zbrush, and later use the projection-technique for 3d meshes, If I can't get a good workflow going without matcaps that is
So I took my own advice and picked a texture from Faf and just tried to recreate the values and color using my bakes. Without any colorpicking or cheating. ^^ I simply tried to emulate the style and come as close and I could. I can now see that maybe I didn't do a great job of nailing the values but, hey, it's progress! I also came to the realization that the two bottom old bricks will never look good, no matter what composite magic I do. So far so good!
I'm attaching the new bakes aswell!
I boiled it down to broader strokes and less cavity and edges on the rough stones. I did this by removing alot of the cavity from the rock, and using the Paint Daubs filter on the cavity maps to get illusion of broad painted strokes.
Once again we see the difference between the top two stone slabs and the bottom ones. Good vs bad sculpt.
I wrote a response to this last week and polycount ate it, twice. Something to do with posting attachments?
Anyway, @Jacob, your third attempt is killer. Matching the reference was a really good call. #4 is good as well, but you could give the directional light a stronger color and work more color variation into the stone.
Your second attempt, and especially the first, were too low-contast. Be careful when you use gradient maps, they're flattening out the values of your greyscale texture. You can see exactly how much if you go into proof mode and turn the gradient maps on and off. Setting them to color blending mode instead of normal mode helps here.
Here's my attempt. (Download psd)
-I used a diffuse map from nDo instead of the standard AO because I wanted crisper details, but normally I don't use diffuse maps because I like having my cavity and AO separate.
-When I'm setting up my gradient maps I use color mode instead of standard because I don't want my values to move around. Even so, color layers can sometimes modify the underlying values so I'm toggling in and out of poof mode while I work to check.
-Looking at it now, the metal could be much more metal-ly. I didn't use a matcap bake but one could have helped here.
-I think my first attempt was stronger. It had less depth but more reflected light.
Blender does have a matcap render mode, but that's not what I'm using when I bake. I get my matcap spheres by screengrabbing a pic of a subdivided sphere with matcap applied from either Blender or ZBrush, and then clean it up in photoshop and plug into my Blender material.
How so?
Tried it with your maps then worked some on it, think it turned out ok, some parts, like the highlights are a bit underdeveloped right now.
Holyshit it's already been a year what the fuck. It's time to go 3d with this shit! I wasn't really going to show this stuff to anyone, so I'm sorry for the messyness! Lets get this shit show on the road!
I just happened to be sculpting some random skull yesterday and figured I'd give this another bash. The understanding I got from this thread a year ago was that what really matters is the SCULPT. Like seen in the earlier examples it doesn't really matter what you do in PS, unless you re-paint the entire texture, if the sculpt isn't clean or looks good.
So here's the sculpt :
And here's what I came up with, with minimum actual painting:
Sitting on 220 tris and 256x256 resolution. ( Bad bake, hence the warping. I'm lazy like that)
Looking at it now I could've been more aggressive with the saturation. Without the " no handpainting " limitation the next step would be to add more color variation and adding subtle strokes and fixing up some of the darker areas that look very desaturated.
So there you go. The .zip contains the UVed low-poly model and AO, normals and bent-normals, same as before.
Disclaimer : I'm doing this for educational purposes and it'd be great if the files are used as such.
EDIT : Updated the kit with proper shading and edge padding!!!
@Eric. Nice, though I would've gone with less-saturated shadow colors and a stronger specular reflection. I'm glad you mentioned the thing about normalmapped hard edges.
@Tectonic Speaking for myself it's because I'm using lighting from a matcap sphere, not normal map channels.
This is how I do it anyways, super simple and gives alot of control :
On 3d object I bake a bent normal-map to do this, instead of taking the green channel from the tangent space normal.
@pixelb : Thanks! I'm trying to step away from cavity, it's just feels so over-used, so it's very subtle here but maybe I took it a bit too far! I do agree that it lacks alot of contrast looking back at it!
More stupid funsies with the bakes, haha, there's a fine line between "Color Variation" and "Clown Face" :
Very cool working with matcaps like that, looks very cool!
I need to investigate further how to do this in Maya!
Gradient maps and not even 1% hand painted.
@edit, Tried with floor texture. I used faf work as reference
Yeah, one of the biggest takeaways from this thread is that you can't run a mediocre sculpt through gradient maps and a nice stack in photoshop and expect good results. I was looking at tutorials from Faf and Orb etc a couple of years ago and thought "Man, that looks easy! Just a bunch of bakes in photoshop on the correct blend-mode!" NO! Wrong Past-Me! It actually takes a lot of sculpting effort and skill, aswell as a lot of touching up in photoshop, handpainting over details and creating lighting and gradients that you can't get from a sculpt only.
I'm going to shamelessly direct you do this thread if you're interested in more specific material-definitiony stuff : http://polycount.com/discussion/191774/hand-painted-sculpt-defining-materials#latest
Here's one of the loose breakdowns from one of the materials going sculpted > handpainted :
@riceart : Really nice! I like that there's not too much Cavity coming through there, my only tiny nitpick would be to maybe lighten it up a bit so that the dark areas aren't aaas black, but that's just me haha, really good, thanks for taking your time and try stuff out!
@Jakob Gavelli yeah but its just a matter of contrast adjustment and some paintover, as for this new wood study, i will write in other thread