http://zhihu.com/people/bopengbopeng
-
http://withablink.com
- http://zhihu.com/people/bopengbopeng
Block or Report
Block or report BlinkDL
Report abuse
Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
Report abusePinned
-
SmallInitEmb Public
LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
547 contributions in the last year
Less
More
Contribution activity
February 2023
Created 23 commits in 3 repositories
Created an issue in ggerganov/ggml that received 2 comments
Suggestion: RWKV Language Model
Hi I am the dev of https://github.com/BlinkDL/ChatRWKV and it is a RNN (so faster and saves VRAM) that can match transformer performance (and alrea…
2
comments


