cinera_handmade.network/cmuratori/hero/code/code020.hmml

[video output=day020 member=cmuratori stream_platform=twitch stream_username=handmade_hero project=code title="Debugging the Audio Sync" vod_platform=youtube id=hELF8KRqSIs annotator=jacebennett annotator=Miblo annotator=garlandobloom]
[2:44][Fixing an off by one error]
[5:12][Explanation of off by one errors]
[7:13][Overview of the state of our audio code]
[11:05][A breakdown of how time is spent during each frame]
[14:07][A possible, though not great, solution to audio latency]
[16:22][Tradeoff between audio lag and input lag]
[17:51][Falling back to a little bit stupider]
[21:58][Beginning to change the code for the audio output method]
[22:48][Finding the minimum expected audio latency]
[27:31][Converting to seconds using dimensional analysis]
[31:34][Writing sound based on the audio latency]
[34:14][Great aside about keeping code fluid and a bit messy in the early stages]
[37:00][Determining the position to write the audio to]
[46:27][How to deal with the low latency case]
[51:16][A puzzling situation]
[53:00][The aha moment]
[55:34][The approach we will be taking for low latency]
[57:36][The higher latency approach]
[1:01:14][Another snag]
[1:07:08][Putting our approach down in words]
[1:13:02][Implementing the two case latency handling]
[1:18:34][Do over due to deleted code]
[1:20:08][Putting in the latency branching code]
[1:23:35][Determining if the sound card is latent]
[1:26:02][Mapping the WriteCursor and the PlayCursor into the same space]
[1:27:51][Overview of the code determining how to write the sound]
[1:30:00][Cleaning up]
[1:31:22][How can we possibly predict how many bytes the game should write?]
[1:33:02][Getting sound output separately with GameGetSoundSamples()]
[1:36:45][More cleaning up]
[1:37:43][Computing SafetyBytes]
[1:39:06][Implementing GameGetSoundSamples() in the game code]
[1:40:10][Testing is surprisingly successful, no bugs? NO WAY!]
[1:42:47][Improving our sound output debug drawing]
[1:48:25][Recording some additional details in our markers]
[1:56:36][An assertion fires and some cleanup]
[1:58:33][First look at the debug drawing output and adding global pause key]
[2:02:38][Taking a good look at the debug drawing output]
[2:04:40][A couple early questions]
[2:05:47][Final Thoughts?]
[2:06:42][Drawing another debug marker]
[2:10:53][Improving our estimate of the PlayCursor position to reduce latency]
[2:17:59][Taking a look at how our estimate lines up]
[2:19:13][Drawing our 480 sample jitter window]
[2:22:15][Q&A][:speech]
[2:22:58][Did you try the audio without OBS?]
[2:24:15][Is it inexpensive to query for the play cursor and the write cursor?]
[2:25:03][Audio seems to be the most complex part until now, which will be the next most complicated thing?]
[2:26:58][Audio asserts are a pain when you're debugging other things. Change to log messages.]
[2:27:46][If we had a buffer that played from start to finish, would it be a valid syncing method to manually set AudioTimer = VideoTimer?]
[2:28:45][Fully visualize waveforms and remove gradient. Turn entire thing into massive audio visualizer.]
[2:29:42][Could you please increase ToneHz to 512, my crappy laptop speakers can't output 256?]
[2:30:29][Will this audio system be able to handle music and sound, or will the game have to mux the audio for us?]
[2:31:08][How will you make sure that you don't have regressions in some parts that are not that easy to spot right away?]
[2:31:54][I'm sorry if I'm being slow, but I still don't truly understand why exactly the audio is jumping. It just seems like we should be able to handle it more simply.]
[2:32:39][Why is the pitch of the sound changing after the game has been running a little while?]
[2:39:55][Callback to earlier half of question: (I'm sorry if I'm being slow, but I don't truly understand why the audio is skipping.) The original audio skipped when we moved the latency to be inside of three frames.]
[2:42:25][If it's not too much of an issue, can we have line numbers on the side when you are coding so we can get a grip of where you are.]
[2:43:08][It's more likely to be the accumulation of a small value onto a larger value that is a numerical problem. Mantissas not lining up.]
[2:44:03][Wrap-up][:speech]
[/video]
Cinera 0.7.0 Update Add output parameter to all of hero/code, hero/intro-to-c and hero/misc, preserving the current URLs while allowing different .hmml filenames, notably for hero/misc which now gets sorted chronologically. Update the cinera__*.css files 2020-05-09 20:59:36 +00:00			`[video output=day020 member=cmuratori stream_platform=twitch stream_username=handmade_hero project=code title="Debugging the Audio Sync" vod_platform=youtube id=hELF8KRqSIs annotator=jacebennett annotator=Miblo annotator=garlandobloom]`
Relocate riscy and add newly converted hero The idea here is to reduce the amount of superfluous stuff downloaded to each server running cinera 2017-12-06 22:26:13 +00:00			`[2:44][Fixing an off by one error]`
			`[5:12][Explanation of off by one errors]`
			`[7:13][Overview of the state of our audio code]`
			`[11:05][A breakdown of how time is spent during each frame]`
			`[14:07][A possible, though not great, solution to audio latency]`
			`[16:22][Tradeoff between audio lag and input lag]`
			`[17:51][Falling back to a little bit stupider]`
			`[21:58][Beginning to change the code for the audio output method]`
			`[22:48][Finding the minimum expected audio latency]`
			`[27:31][Converting to seconds using dimensional analysis]`
			`[31:34][Writing sound based on the audio latency]`
			`[34:14][Great aside about keeping code fluid and a bit messy in the early stages]`
			`[37:00][Determining the position to write the audio to]`
			`[46:27][How to deal with the low latency case]`
			`[51:16][A puzzling situation]`
			`[53:00][The aha moment]`
			`[55:34][The approach we will be taking for low latency]`
			`[57:36][The higher latency approach]`
			`[1:01:14][Another snag]`
			`[1:07:08][Putting our approach down in words]`
			`[1:13:02][Implementing the two case latency handling]`
			`[1:18:34][Do over due to deleted code]`
			`[1:20:08][Putting in the latency branching code]`
			`[1:23:35][Determining if the sound card is latent]`
			`[1:26:02][Mapping the WriteCursor and the PlayCursor into the same space]`
			`[1:27:51][Overview of the code determining how to write the sound]`
			`[1:30:00][Cleaning up]`
			`[1:31:22][How can we possibly predict how many bytes the game should write?]`
			`[1:33:02][Getting sound output separately with GameGetSoundSamples()]`
			`[1:36:45][More cleaning up]`
			`[1:37:43][Computing SafetyBytes]`
			`[1:39:06][Implementing GameGetSoundSamples() in the game code]`
			`[1:40:10][Testing is surprisingly successful, no bugs? NO WAY!]`
			`[1:42:47][Improving our sound output debug drawing]`
			`[1:48:25][Recording some additional details in our markers]`
			`[1:56:36][An assertion fires and some cleanup]`
			`[1:58:33][First look at the debug drawing output and adding global pause key]`
			`[2:02:38][Taking a good look at the debug drawing output]`
			`[2:04:40][A couple early questions]`
			`[2:05:47][Final Thoughts?]`
			`[2:06:42][Drawing another debug marker]`
			`[2:10:53][Improving our estimate of the PlayCursor position to reduce latency]`
			`[2:17:59][Taking a look at how our estimate lines up]`
			`[2:19:13][Drawing our 480 sample jitter window]`
Fix some incorrectly converted annotations Also apply some :speech categorisation 2018-03-07 21:48:09 +00:00			`[2:22:15][Q&A][:speech]`
Relocate riscy and add newly converted hero The idea here is to reduce the amount of superfluous stuff downloaded to each server running cinera 2017-12-06 22:26:13 +00:00			`[2:22:58][Did you try the audio without OBS?]`
			`[2:24:15][Is it inexpensive to query for the play cursor and the write cursor?]`
			`[2:25:03][Audio seems to be the most complex part until now, which will be the next most complicated thing?]`
			`[2:26:58][Audio asserts are a pain when you're debugging other things. Change to log messages.]`
			`[2:27:46][If we had a buffer that played from start to finish, would it be a valid syncing method to manually set AudioTimer = VideoTimer?]`
			`[2:28:45][Fully visualize waveforms and remove gradient. Turn entire thing into massive audio visualizer.]`
			`[2:29:42][Could you please increase ToneHz to 512, my crappy laptop speakers can't output 256?]`
			`[2:30:29][Will this audio system be able to handle music and sound, or will the game have to mux the audio for us?]`
			`[2:31:08][How will you make sure that you don't have regressions in some parts that are not that easy to spot right away?]`
			`[2:31:54][I'm sorry if I'm being slow, but I still don't truly understand why exactly the audio is jumping. It just seems like we should be able to handle it more simply.]`
Fix timecode chronology in code{020,128,184,187} 2018-02-05 23:59:34 +00:00			`[2:32:39][Why is the pitch of the sound changing after the game has been running a little while?]`
Relocate riscy and add newly converted hero The idea here is to reduce the amount of superfluous stuff downloaded to each server running cinera 2017-12-06 22:26:13 +00:00			`[2:39:55][Callback to earlier half of question: (I'm sorry if I'm being slow, but I don't truly understand why the audio is skipping.) The original audio skipped when we moved the latency to be inside of three frames.]`
			`[2:42:25][If it's not too much of an issue, can we have line numbers on the side when you are coding so we can get a grip of where you are.]`
			`[2:43:08][It's more likely to be the accumulation of a small value onto a larger value that is a numerical problem. Mantissas not lining up.]`
Fix some incorrectly converted annotations Also apply some :speech categorisation 2018-03-07 21:48:09 +00:00			`[2:44:03][Wrap-up][:speech]`
Relocate riscy and add newly converted hero The idea here is to reduce the amount of superfluous stuff downloaded to each server running cinera 2017-12-06 22:26:13 +00:00			`[/video]`