[ToDo]: V0.1.6 Iteration Plan #50

Closed

Assignees

Labels

Huiqiang Jiang (iofu728)

opened

on Jul 18, 2024

V0.1.6 Iteration Plan

Feature Support

Code refactors, support "attn_type", "kv_type"; [PreRelease]: SCBench #96
Resupport search pattern; Fix(MInference): fix the search pattern feature #156
Resupport chuck FFN/LN; Feature(MInference): support transformers>=4.46.0, add chunk mlp #133
Add SCBench codebase; [PreRelease]: SCBench #96

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests