``` emb_h = get_1d_sincos_pos_embed_from_grid(embed_dim // 2, grid[0]) # (H*W, D/2) emb_w = get_1d_sincos_pos_embed_from_grid(embed_dim // 2, grid[1]) # (H*W, D/2) ``` In `get_2d_sincos_pos_embed_from_grid` , since `w` goes first, doesn't `grid[0]` strand for `emb_w` and grid[1] stand for `emb_h`? Is this a typo here?
In
get_2d_sincos_pos_embed_from_grid, sincewgoes first, doesn'tgrid[0]strand foremb_wand grid[1] stand foremb_h? Is this a typo here?