{"version": "1.0", "type": "rich", "title": "Anatomy of a Falcon", "author_name": "kontextmaschine", "author_url": "https://kontextmaschine.com", "provider_name": "kontextmaschine", "provider_url": "https://kontextmaschine.com", "url": "https://kontextmaschine.com/post/178152604589/", "html": "

heatandapathy:

\n
\n

outerloop:

\n\n
\n

We recently announced Falcon Age, a game about nurturing a falcon from a baby, bonding with them, and together resisting the forces that colonise your planet. Falcon Age will be out in 2019 for PS4 and PS VR.

\n

\n\nWe showed off the game at PAX last week, got a great response, especially on the falcon. Let\u2019s do a deep dive of the design of the falcon, animation and rig setup, AI and navigation, feather tech, and raptor sounds.

\n

\n

Falcon Design

\n

Chandana Ekanayake and Darran Hurlbut

\n
\"image\"

\n\nOur falcon design combines multiple raptor types. She is big as a golden eagle, fights like a hawk, has some eagle-hawk resemblance, some owl-like tufts, and falcon tendancies. She\u2019s one of the last of her kind left in our world and we wanted to make her unique visually for the story and also visually stand out during gameplay against the sky and desert like environments.

\n
\"image\"

\n\nOne of the early inspirations for Falcon Age came from videos of golden eagles hunting large mountain goats. That led to some research on falconry and the idea of having a falcon as a pet and designing mechanics and gameplay around that core idea. We made a rough prototype early on to test out the ideas. The first time we successfully whistled for the bird in VR and saw the scale change from it approaching from a distance to landing on our hand, we knew we were on to something that could serve as the core of a unique game.\u00a0\u00a0

\n

Animation and Rig

\n

Aung Zaw Oo

\n
\"image\"

FALCON FEET TRACKING

\n

There are lots of animation options out there, but none of them would easily solve our specific falcon feet tracking needs. Inverse kinematic setups, root motion and other complex plugins could do the job if we had a bigger team and more time to dedicate to it. We wanted a more predictable outcome so we went with a multiple pose based solution made in 3dsmax.\u00a0\u00a0

\n

However, the biggest reason for not using IK, is that this is the best way I could come up within a couple of days. We were building the prototype so fast back at the beginning of the project that we didn\u2019t have time to look at what other solutions are available. This is the most reliable and least ugly way I found and we\u2019ve stuck with it since. If it\u2019s not broken, don\u2019t fix it.

\n

Here is how I imagined the bird claws blending IRL. The ball is the fist that is attached to the VR motion controls.There are limits to this method. The claws needs to be able to wrap around a fair chunk of the fist and the fist pose needs to be as spherical as possible.

\n
\"image\"
\"image\"

\n

\n\n Note that head and legs are siblings of the pelvis. This makes the bone masking and making separate blend trees easier. Ignore the word \u2018eagle\u2019 in the naming. That was just a temp asset name before we figured out the bird design.

\n


\n
\"image\"

Short version of how its done; the fist is a ball and the bird\u2019s feet rotate around the ball using 30 blend poses and shuffle animation to get the feet back to center when the ball(motion hand) has rotated too far.

\n

\n\n30 Blend Poses on a ball\n\n

\n
\"image\"


\n

A shuffle animation let feet recenter

\n
\"image\"


\n

And the the blends start again after that quick shuffle animation from the new rotation of the hand. According to our programmer Justin, he is doing some regular old quaternion and linear algebra math. And I\u2019m using 3 float values that he\u2019s giving me and feeding them into those anim blend states.\n\n

\n

\n

For baby bird, the 2nd knuckle on the index finger is treated like a ball.\u00a0

\n
\"image\"

\n\nThe one edge case where the ball concept doesn\u2019t work is when the glove is pointed directly down. Pictured below.\n\n

\n
\"image\"

\n

We had several ways we could\u2019ve dealt with that case. One solution was to have a collider on the forearm part of the glove and have the bird fly away if bird\u2019s collision intersects with it. Ultimately we decided to let it be as is. It\u2019s more player friendly that way since it lets you scratch your left hip while in VR without having the bird leave you. Also most people would never have their hands positioned that way in normal play.\u00a0

\n

Unless they\u2019re playing in a headstand for some reason.\u00a0All kinds of animation features would look wrong or broken in a headstand.

\n
\"image\"

FALCON HEAD TRACKING

\n

Short version of how its done; the head (bone_Head) is a direct child of the highest object in the bird skeletal hierarchy ( bone_Root ).

\n

Bone_Root\u2019s position(not rotation) follows the position of the motion controller and bone_Head counters that motion. Basically a 2-object hierarchy where a positional blend is used to counter motion of the parent object to keep the child object in same global position. The rest of the bird body uses a blend of 27 poses to try its best to keep the bird looking natural.

\n
\"image\"

With the size of the adult bird we have, a 12 cm translation in all axis(24x24x24 cube) seemed ideal for getting the stabilizer effect without stretching the neck too much. The head will also move at the edge of that range and when the motion hand stops moving, that new position is now the new center and another 24cm cube is formed there.\u00a0 Math wise, headlock is mostly just a vector transform with a lot of extra \u2018fluff\u2019 for limiting speed, transitioning in and out, and moving the lock point when it gets too far from the body but the bird is still in the area.\n\n

\n


\n
\"image\"


\n

Bird Navigation and AI

\n

Justin LaLone

\n

BIRD BOREDOM

\n

For the most part, the falcon obeys Ara\u2019s commands and follows her around. \u00a0If you stand around long enough in one area while the bird is just circling or if you launch her with no orders, she will start looking for something else in the area to do - usually hunting or landing on a point of interest. \u00a0She will also take some initiative when perched on Ara if anything else tries to grab her (she\u2019s possessive like that), and likes to help lead Ara to the next hole in lightning golf.

\n

SUN BLINDING PREY

\n

Some of the prey, such as the rabbits, are very skittish and as soon as they notice a falcon diving towards them they will take off for the nearest bolthole. \u00a0They have a more difficult time seeing Ara\u2019s bird if she approaches with the sun behind her, so paying attention to where the light is coming from and sending the bird from that direction can make catching prey easier and more reliable. \u00a0On the other hand, simply diving from higher up can be good too, as the bird can pick up more speed before being noticed, giving her prey less time to dodge out of the way.

\n
\"image\"

Coming in fast and and from the sun, for a guaranteed hit.

\n

FALCON 3D NAVIGATION

\n

Getting a flying animal to reliably traverse a 3D space in a somewhat natural looking way isn\u2019t something you typically find out of the box in a game engine. \u00a0We have roughly three levels of bird-navigation logic going on to get the bird from point A to point B without running into too many things or getting stuck in a corner.

\n
\"image\"

For high-level navigation to find its way through the world, we build a 3D navigation graph and use A* to find a path. \u00a0What\u2019s probably somewhat unique in our implementation is that we are using the fairly new Unity job system to do all our A* pathfinding, giving us fast searches that stay off the main thread, allowing more time for other AI, physics, and more stuff in general. \u00a0Most of the graph is generated automatically, with manually placed connections for flying through narrow gaps like windows that are small or require an approach from a good angle.

\n
\"image\"

\n\nThe purple line is a rough path for it to follow to get around the big rocks in between where the falcon started and where Ara is standing. \u00a0The bird doesn\u2019t try to follow this line very closely; it would be trying to make some pretty strange and sharp turns if it tried, so as soon as it has a clear shot to the next part of the path it heads there instead.\n\n

\n
\"image\"

Sometimes smaller objects or moving objects can get in the way. \u00a0The falcon looks ahead and goes over or around these objects. \u00a0This rock is actually just big enough that it would normally navigate around it with A*, but I forced it to \u201cforget\u201d about that for now. \u00a0Here, it\u2019s turning left to go around the rock - the red lines show where it has been looking for the past few frames. \u00a0It usually won\u2019t try to go under things in this way, but the A* navigation can direct it to go under arches or walkways.

\n

The last level of bird flight logic is the actual maneuvering logic, or how the bird decides how fast it wants to go, how much to ascend or descend, how quickly to turn, and how it applies physics accelerations, limited by what it is allowed to do, to get there. \u00a0This feeds into the animation system telling it how hard the bird is working, what sort of pose it should be in, if it should be banking, etc. \u00a0The object avoidance is tied in somewhat strongly with this, but all the A* navigation is completely separate. \u00a0It is also a big pile of math and logic.

\n


\n

Feathers and Rendering

\n

Ben Golus

\n

The small body feathers, or contour feathers, on our birds flutter in the wind, and react to the player\u2019s hands brushing against them to give a greater sense of tactile interactivity. The way this was done for the PAX demo is a bit of a hack which I hope to replace before we ship. (This of course means it\u2019s the solution that will ship with the game.) The short description is each small feather on the bird is a treated like many grass or vegetation shaders. Several overlapping sine waves are used to calculate some simple noise used to flutter the feathers and give them some life. Their timing is offset by a random value per feather stored in the vertex color, and the flutter movement is scaled also using the vertex color. This means the base of the feathers don\u2019t move, but the tips do. It also means longer feathers move more than shorter ones.

\n
\"image\"

\n\nUnlike most grass shaders, we need the feathers to not move in random directions, so we can\u2019t use world or local space directions. Plus this is on a skinned mesh which makes the direction even more dynamic. Instead I use a combination of the feather\u2019s vertex normal and tangent so the feathers flutter in and out and side to side relative to their orientation. This isn\u2019t strictly accurate, but for small movements like this it won\u2019t be obviously wrong.\n\n

\n

\n

To handle hand interactions, the player\u2019s hand has a script which tracks the bones and creates a list of capsules that follow the shape of each finger, and a sphere for the palm. If the hand is in range, the vertex shader iterates over the list of capsules to find closest distance to one and softly scales down the flutter if a capsule one is overlapping it. The feathers are also squished down towards the body. The capsules are oversized as the overlapping tests are soft, so this isn\u2019t an instant on-off, but a gradual change. It\u2019s roughly tuned so that once the visible finger is touching the feather it has stopped moving entirely and will push down.

\n
\"image\"

\n\nHere\u2019s an early test of this system in action. You can see how the feathers react to the sphere before it actually touches it, but the interaction is still convincing.\n\n

\n
\"image\"
\"image\"

For the final release of the game I\u2019d like to move to a geometry shader or compute shader approach which would solve some of the issues the effect currently has when only one vertex of a feather is being overlapped, and the fact the feathers light normals don\u2019t change when being touched.

\n

FALCON DAMAGE FEEDBACK

\n

We needed some way to show when the bird is hurt, and we wanted to avoid using a health bar or similar mechanic as much as possible. Animation is used to make the bird look tired, and in pain, but we still didn\u2019t find that it was clear enough to users that she had taken damage. We decided we wanted her to look physically damaged with blood and frayed feathers to really strongly communicate her state. The obvious answer was to do a material swap. However we also wanted to show a gradual increase in damage rather than a hard on / off, and did not want to have to have a lot of different maps. There was also the issue that most feathers shared the same UVs, which meant blood spots would be repeated all over the bird.

\n

The solution we ended up with was done in two parts. First was feather damage and fraying. The alpha channel of each feather is setup in a special way so that both an undamaged and damaged version exist in the alpha at different opacities. The feathers are using alpha test cutout (actually alpha to coverage) at 50% opacity when at normal health, and 25% opacity when damaged to switch between the two states.

\n
\"image\"

\n

For blood splatter the bird has a second UV for the blood texture so we don\u2019t have to reuse the original feather texture UVs, and then we blend in the blood on top of the base texture. The result is we only need one base texture set, and one blood splatter texture set for the bird and we can get variable damage effects on the bird.

\n
\"image\"
\"image\"
\"image\"


\n

Raptor Sounds

\n

Rob Pearsall

\n
\"image\"

The bird wasn\u2019t designed to be different - futuristic or magical - from any bird in our world, just an amalgam of several flying raptors (except for wearing hats); so, it didn\u2019t make any sense to create a voice for it that might sound \u2018cinematically awesome\u2019 - it just had to work and be believable.

\n

That said, I did have the choice of \u201cborrowing\u201d the calls of any raptor I thought would communicate to the player the various moods, feelings, and responses of the bird. \u00a0So, I listened to the sounds that raptors make; and to my surprise, the biggest, most impressive bird - the eagle - was absolutely the worst sounding predator of them all. \u00a0First place for \u201cdon\u2019t use this\u201d.

\n

The hawk is always a great choice. \u00a0Everybody loves the screech of a hawk. \u00a0I used to think that there was only one good recording of a hawk screech and every sound designer owned it and that\u2019s why all hawks in all shows and movies sound the same. \u00a0Not true. \u00a0It turns out, all hawks sound the same. \u00a0Not much variation at all. \u00a0Now, don\u2019t get me wrong, it sounds awesome, so yea\u2026 we\u2019ve got that sound on our bird too. \u00a0But that\u2019s not all.

\n

The best thing I had going for me was that I didn\u2019t have to limit our falcon voice to one specific kind of falcon; and there are many kinds. \u00a0Because of this, I could liberally choose any sound any falcon produces that makes sense as a kind of emotional statement from the bird. \u00a0

\n

\n

Conveniently, the emotions were limited; I name them as statements from the bird:

\n

Getting a recording of a raptor that\u2019s annoyed is really easy; show up with a bunch of recording gear, get into it\u2019s space, and it\u2019s already annoyed. \u00a0So, there\u2019s a lot of material of raptors sounding negative and mad. \u00a0This works for \u2018pain\u2019. \u00a0The hawk\u2019s sounds work for flying responses and attack calls. \u00a0The \u201call is calm\u201d sounds were the difficult ones. \u00a0There were several chirps that worked, but then I had to edit a lot of different kind of calls to get partial, short squawks that fit with the chirps, and it worked.

\n

Keeping track of the bird sonically while in game\u2026 well, that\u2019s another story for later.

\n


\n

Thank you!

\n
\"image\"

Thanks for reading. For more info and latest updates follow @outerloopgames

\n
\n\n

@demonladytakkuri

\n

LOOK AT IT :0

\n
", "thumbnail_url": "https://kontextmaschine.com/media/tumblr_inline_pex0ebpIG31w7x9pm_540_ad328e0903a5.png", "thumbnail_width": 540, "thumbnail_height": 542}