More Facetracking features

[TheRealDadbeard]

Will you consider the possibility to stick certain effects to face regions? I was using the move plugin in the past to attach images and other shader effects to my face but it eats VRAM like breakfast.

This would be a great alternative. Really hope to see this in the future!

[xurei]

Could you give me a concrete example of what you mean by "stick certain effects to face regions" ?

[TheRealDadbeard]

Yeah I actualy have an example when i used move pluings with the AR effects. Attached a shader to the eyes and the whiskers image to my nose.

It looks cursed but my viewers REALLY loved it.

[xurei]

I see. I'm not certain that Shadertastic will do a better job, it takes about 5ms/frame for the face tracking to process once.

I could make a filter that does the face tracking only once, then the other shader could use this data, limiting to one face tracking execution instead of one per filter....
but it is not really easy to setup as the end-user 😕

[TheRealDadbeard]

Ah well okay. I just saw how well the laser eyes shader worked and tracked it perfectly and thought maybe this could be adapted.

[xurei]

It can. I made some other personal effects, like texturing my face and make the texture sound-reactive.
The two main "issues" are : it takes a long time to make something releasable-grade (compared to "make-it-for-myself"), and as I said earlier, the time budget it takes for the face tracking to work properly is quite high (~5ms per effect on a decent PC).

It is possible though, for instance if you're okay with streaming in 30FPS, you can in theory stack up to 5 face tracking effects together, which can make for many cool effects already. In 60FPS, more that 2 will most likely drop frames.

Anyways, if you have a precise effect in mind, feel free to make a suggestion, I'm currently looking for ideas to enrich the online effects library.

Besides, as I mentioned in #8 I am currently in the writing of the documentation, so you will be able to write your own shaders yourself. I can also make a custom, paid shader for you if you have something very specific in mind.

[TheRealDadbeard]

Okay that makes some sense. Enabling that laser bumps my cpu and gpu usage to around 15% so it already is somewhat heavy.

But thanks for explaining it!