Question about model

[chsurvey]

as long as I saw from tech report video from https://www.bilibili.com/video/BV1zJ4m1K7cj/
I can't find where bert model is used. it looks like they only used llama model for autoregressive prediction.

I really want to know how model structure looks like. where can I find those information, besides github code?