Swiglu Struct Reference

Swiglu Struct Reference#

Composable Kernel: ck_tile::moe::Swiglu Struct Reference
Public Member Functions | Public Attributes | List of all members
ck_tile::moe::Swiglu Struct Reference

#include <moe_flatmm_kernel.hpp>

Public Member Functions

CK_TILE_HOST_DEVICE Swiglu (float alpha_=1.702f, float limit_=7.0f)
template<typename T>
CK_TILE_HOST_DEVICE T operator() (T gate, T linear) const

Public Attributes

const float alpha
const float limit

Constructor & Destructor Documentation

◆ Swiglu()

CK_TILE_HOST_DEVICE ck_tile::moe::Swiglu::Swiglu ( float alpha_ = 1.702f,
float limit_ = 7.0f )
inline

Member Function Documentation

◆ operator()()

template<typename T>
CK_TILE_HOST_DEVICE T ck_tile::moe::Swiglu::operator() ( T gate,
T linear ) const
inline

Member Data Documentation

◆ alpha

const float ck_tile::moe::Swiglu::alpha

◆ limit

const float ck_tile::moe::Swiglu::limit
The documentation for this struct was generated from the following file: