Namespaces | |
namespace | Barrier |
namespace | CPol |
namespace | DepCtr |
namespace | DPP |
namespace | ElfNote |
namespace | EncValues |
namespace | Exp |
namespace | GenericVersion |
Generic target versions emitted by this version of LLVM. | |
namespace | HSAMD |
namespace | HWEncoding |
namespace | Hwreg |
namespace | ImplicitArg |
namespace | IsaInfo |
namespace | MFMAScaleFormats |
namespace | MTBUFFormat |
namespace | PALMD |
namespace | SDWA |
namespace | SendMsg |
namespace | Swizzle |
namespace | UCVersion |
namespace | UfmtGFX10 |
namespace | UfmtGFX11 |
namespace | VGPRIndexMode |
namespace | VirtRegFlag |
namespace | VOP3PEncoding |
namespace | VOPD |
Typedefs | |
using | FunctionVariableMap =DenseMap<Function *,DenseSet<GlobalVariable * > > |
using | VariableFunctionMap =DenseMap<GlobalVariable *,DenseSet<Function * > > |
template<unsigned Bit,unsigned D = 0> | |
using | EncodingBit =EncodingField< Bit, Bit,D > |
Variables | |
constuint64_t | RSRC_DATA_FORMAT = 0xf00000000000LL |
constuint64_t | RSRC_ELEMENT_SIZE_SHIFT = (32 + 19) |
constuint64_t | RSRC_INDEX_STRIDE_SHIFT = (32 + 21) |
constuint64_t | RSRC_TID_ENABLE = UINT64_C(1) << (32 + 23) |
static constexpruint32_t | ExtendedFltRoundOffset = 4 |
Offset of nonstandard values for llvm.get.rounding results from the largest supported mode. | |
static constexpruint32_t | F32FltRoundOffset = 0 |
Offset in mode register of f32 rounding mode. | |
static constexpruint32_t | F64FltRoundOffset = 2 |
Offset in mode register of f64/f16 rounding mode. | |
constuint64_t | FltRoundConversionTable |
constuint64_t | FltRoundToHWConversionTable |
const int | OPR_ID_UNKNOWN = -1 |
const int | OPR_ID_UNSUPPORTED = -2 |
const int | OPR_ID_DUPLICATE = -3 |
const int | OPR_VAL_INVALID = -4 |
usingllvm::AMDGPU::EncodingBit = typedefEncodingField<Bit, Bit,D> |
Definition at line382 of fileAMDGPUBaseInfo.h.
usingllvm::AMDGPU::FunctionVariableMap = typedefDenseMap<Function *,DenseSet<GlobalVariable *> > |
Definition at line33 of fileAMDGPUMemoryUtils.h.
usingllvm::AMDGPU::VariableFunctionMap = typedefDenseMap<GlobalVariable *,DenseSet<Function *> > |
Definition at line34 of fileAMDGPUMemoryUtils.h.
anonymous enum |
Enumerator | |
---|---|
AMDHSA_COV4 | |
AMDHSA_COV5 | |
AMDHSA_COV6 |
Definition at line56 of fileAMDGPUBaseInfo.h.
enumllvm::AMDGPU::AMDGPUFltRounds : int8_t |
Return values used for llvm.get.rounding.
When both the F32 and F64/F16 modes are the same, returns the standard values. If they differ, returns an extended mode starting at 8.
Definition at line96 of fileSIModeRegisterDefaults.h.
Enumerator | |
---|---|
FEATURE_NONE | |
FEATURE_FMA | |
FEATURE_LDEXP | |
FEATURE_FP64 | |
FEATURE_FAST_FMA_F32 | |
FEATURE_FAST_DENORMAL_F32 | |
FEATURE_WAVE32 | |
FEATURE_XNACK | |
FEATURE_SRAMECC | |
FEATURE_WGP |
Definition at line138 of fileTargetParser.h.
Enumerator | |
---|---|
SGPR_SPILL |
Definition at line1602 of fileSIInstrInfo.h.
Enumerator | |
---|---|
NoFastRules | |
Standard | |
StandardB | |
Vector |
Definition at line174 of fileAMDGPURegBankLegalizeRules.h.
Enumerator | |
---|---|
NO_ERROR | |
INVALID_FEATURE_COMBINATION | |
UNSUPPORTED_TARGET_FEATURE |
Definition at line163 of fileTargetParser.h.
Enumerator | |
---|---|
fixup_si_sopp_br | 16-bit PC relative fixup for SOPP branch instructions. |
LastTargetFixupKind | |
NumTargetFixupKinds |
Definition at line16 of fileAMDGPUFixupKinds.h.
| strong |
Enumerator | |
---|---|
None | |
FP4 | |
FP8 |
Definition at line58 of fileAMDGPUBaseInfo.h.
GPU kinds supported by theAMDGPU target.
Definition at line35 of fileTargetParser.h.
Enumerator | |
---|---|
DoNotLower | |
UniExtToSel | |
VgprToVccCopy | |
SplitTo32 | |
Ext32To64 | |
UniCstExt | |
SplitLoad | |
WidenLoad |
Definition at line163 of fileAMDGPURegBankLegalizeRules.h.
Enumerator | |
---|---|
INT | |
FP16 | |
BF16 | |
FP32 | |
FP64 |
Definition at line274 of fileSIDefines.h.
Definition at line198 of fileSIDefines.h.
Definition at line101 of fileAMDGPURegBankLegalizeRules.h.
| strong |
Enumerator | |
---|---|
Initial | |
PreRAReentry | |
PostRA |
Definition at line20 of fileAMDGPUIGroupLP.h.
Definition at line35 of fileAMDGPURegBankLegalizeRules.h.
Definition at line475 of fileAMDGPU.h.
Referencesllvm::AMDGPUAS::MAX_AMDGPU_ADDRESS.
Referenced byllvm::GCNTTIImpl::addrspacesMayAlias(), andllvm::AMDGPUAAResult::alias().
void llvm::AMDGPU::buildReadAnyLane | ( | MachineIRBuilder & | B, |
Register | SgprDst, | ||
Register | VgprSrc, | ||
constRegisterBankInfo & | RBI | ||
) |
Definition at line155 of fileAMDGPUGlobalISelUtils.cpp.
ReferencesB,getReadAnyLaneSplitTy(),llvm::LLT::getSizeInBits(), andunmergeReadAnyLane().
Referenced byunmergeReadAnyLane().
uint64_t llvm::AMDGPU::convertSMRDOffsetUnits | ( | constMCSubtargetInfo & | ST, |
uint64_t | ByteOffset | ||
) |
ConvertByteOffset
to dwords if the subtarget uses dword SMRD immediate offsets.
Definition at line2898 of fileAMDGPUBaseInfo.cpp.
Referencesassert(),hasSMEMByteOffset(), andisDwordAligned().
Referenced bygetSMRDEncodedLiteralOffset32(), andgetSMRDEncodedOffset().
| static |
Definition at line79 of fileAMDGPUAsanInstrumentation.cpp.
Referencesllvm::IRBuilderBase::CreateAdd(),llvm::IRBuilderBase::CreateAnd(),llvm::IRBuilderBase::CreateICmpSGE(),llvm::IRBuilderBase::CreateIntCast(), andllvm::Value::getType().
Referenced byinstrumentAddressImpl().
| static |
Definition at line1633 of fileAMDGPUBaseInfo.cpp.
Referenced byllvm::AMDGPU::DepCtr::decodeDepCtr().
unsigned llvm::AMDGPU::decodeExpcnt | ( | constIsaVersion & | Version, |
unsigned | Waitcnt | ||
) |
Waitcnt
for given isaVersion
.Definition at line1462 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
Referenced bydecodeWaitcnt().
Read the hardware rounding mode equivalent of a AMDGPUFltRounds value.
Definition at line247 of fileSIModeRegisterDefaults.cpp.
ReferencesFltRoundToHWConversionTable.
Referenced byllvm::SITargetLowering::lowerSET_ROUNDING().
unsigned llvm::AMDGPU::decodeLgkmcnt | ( | constIsaVersion & | Version, |
unsigned | Waitcnt | ||
) |
Waitcnt
for given isaVersion
.Definition at line1467 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
Referenced bydecodeWaitcnt().
Waitcnt llvm::AMDGPU::decodeLoadcntDscnt | ( | constIsaVersion & | Version, |
unsigned | LoadcntDscnt | ||
) |
LoadcntDscnt
for given isaVersion
.Definition at line1535 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::AMDGPU::Waitcnt::DsCnt,llvm::AMDGPU::Waitcnt::LoadCnt, andllvm::Version.
Waitcnt llvm::AMDGPU::decodeStorecntDscnt | ( | constIsaVersion & | Version, |
unsigned | StorecntDscnt | ||
) |
StorecntDscnt
for given isaVersion
.Definition at line1545 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::AMDGPU::Waitcnt::DsCnt,llvm::AMDGPU::Waitcnt::StoreCnt, andllvm::Version.
unsigned llvm::AMDGPU::decodeVmcnt | ( | constIsaVersion & | Version, |
unsigned | Waitcnt | ||
) |
Waitcnt
for given isaVersion
.Definition at line1454 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
Referenced bydecodeWaitcnt().
Waitcnt llvm::AMDGPU::decodeWaitcnt | ( | constIsaVersion & | Version, |
unsigned | Encoded | ||
) |
Definition at line1479 of fileAMDGPUBaseInfo.cpp.
ReferencesdecodeExpcnt(),decodeLgkmcnt(),decodeVmcnt(),llvm::AMDGPU::Waitcnt::DsCnt,llvm::AMDGPU::Waitcnt::ExpCnt,llvm::AMDGPU::Waitcnt::LoadCnt, andllvm::Version.
void llvm::AMDGPU::decodeWaitcnt | ( | constIsaVersion & | Version, |
unsigned | Waitcnt, | ||
unsigned & | Vmcnt, | ||
unsigned & | Expcnt, | ||
unsigned & | Lgkmcnt | ||
) |
Decodes Vmcnt, Expcnt and Lgkmcnt from givenWaitcnt
for given isaVersion
, and writes decoded values intoVmcnt
,Expcnt
andLgkmcnt
respectively.
Should not be used on gfx12+, the instruction which needs it is deprecated
Vmcnt
,Expcnt
andLgkmcnt
are decoded as follows:Vmcnt
=Waitcnt
[3:0] (pre-gfx9)Vmcnt
=Waitcnt
[15:14,3:0] (gfx9,10)Vmcnt
=Waitcnt
[15:10] (gfx11)Expcnt
=Waitcnt
[6:4] (pre-gfx11)Expcnt
=Waitcnt
[2:0] (gfx11)Lgkmcnt
=Waitcnt
[11:8] (pre-gfx10)Lgkmcnt
=Waitcnt
[13:8] (gfx10)Lgkmcnt
=Waitcnt
[9:4] (gfx11)
Definition at line1472 of fileAMDGPUBaseInfo.cpp.
ReferencesdecodeExpcnt(),decodeLgkmcnt(),decodeVmcnt(), andllvm::Version.
Referenced byllvm::AMDGPUInstPrinter::printSWaitCnt().
Definition at line86 of fileAMDGPUMemoryUtils.cpp.
Referencesllvm::convertUsersOfConstantsToInstructions(),isLDSVariableToLower(), andllvm::SmallVectorTemplateBase< T, bool >::push_back().
| static |
Definition at line1657 of fileAMDGPUBaseInfo.cpp.
ReferencesencodeCustomOperandVal(),Idx,Name,OPR_ID_DUPLICATE,OPR_ID_UNKNOWN,OPR_ID_UNSUPPORTED, andSize.
Referenced byllvm::AMDGPU::DepCtr::encodeDepCtr().
| static |
Definition at line1650 of fileAMDGPUBaseInfo.cpp.
ReferencesOPR_VAL_INVALID.
Referenced byencodeCustomOperand().
| static |
Definition at line1567 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
Referenced byencodeLoadcntDscnt(), andencodeStorecntDscnt().
unsigned llvm::AMDGPU::encodeExpcnt | ( | constIsaVersion & | Version, |
unsigned | Waitcnt, | ||
unsigned | Expcnt | ||
) |
Waitcnt
with encodedExpcnt
for given isaVersion
.Definition at line1496 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
Referenced byencodeWaitcnt().
unsigned llvm::AMDGPU::encodeLgkmcnt | ( | constIsaVersion & | Version, |
unsigned | Waitcnt, | ||
unsigned | Lgkmcnt | ||
) |
Waitcnt
with encodedLgkmcnt
for given isaVersion
.Definition at line1502 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
Referenced byencodeWaitcnt().
| static |
Definition at line1555 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
Referenced byencodeLoadcntDscnt().
unsigned llvm::AMDGPU::encodeLoadcntDscnt | ( | constIsaVersion & | Version, |
constWaitcnt & | Decoded | ||
) |
Loadcnt
andDscnt
components ofDecoded
encoded as an immediate that can be used with S_WAIT_LOADCNT_DSCNT for given isaVersion
.Definition at line1581 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::AMDGPU::Waitcnt::DsCnt,encodeLoadcntDscnt(),llvm::AMDGPU::Waitcnt::LoadCnt, andllvm::Version.
| static |
Definition at line1573 of fileAMDGPUBaseInfo.cpp.
ReferencesencodeDscnt(),encodeLoadcnt(),getCombinedCountBitMask(), andllvm::Version.
Referenced byencodeLoadcntDscnt().
| static |
Definition at line1561 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
Referenced byencodeStorecntDscnt().
unsigned llvm::AMDGPU::encodeStorecntDscnt | ( | constIsaVersion & | Version, |
constWaitcnt & | Decoded | ||
) |
Storecnt
andDscnt
components ofDecoded
encoded as an immediate that can be used with S_WAIT_STORECNT_DSCNT for given isaVersion
.Definition at line1593 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::AMDGPU::Waitcnt::DsCnt,encodeStorecntDscnt(),llvm::AMDGPU::Waitcnt::StoreCnt, andllvm::Version.
| static |
Definition at line1585 of fileAMDGPUBaseInfo.cpp.
ReferencesencodeDscnt(),encodeStorecnt(),getCombinedCountBitMask(), andllvm::Version.
Referenced byencodeStorecntDscnt().
unsigned llvm::AMDGPU::encodeVmcnt | ( | constIsaVersion & | Version, |
unsigned | Waitcnt, | ||
unsigned | Vmcnt | ||
) |
Waitcnt
with encodedVmcnt
for given isaVersion
.Definition at line1487 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
Referenced byencodeWaitcnt().
unsigned llvm::AMDGPU::encodeWaitcnt | ( | constIsaVersion & | Version, |
constWaitcnt & | Decoded | ||
) |
Definition at line1517 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::AMDGPU::Waitcnt::DsCnt,encodeWaitcnt(),llvm::AMDGPU::Waitcnt::ExpCnt,llvm::AMDGPU::Waitcnt::LoadCnt, andllvm::Version.
unsigned llvm::AMDGPU::encodeWaitcnt | ( | constIsaVersion & | Version, |
unsigned | Vmcnt, | ||
unsigned | Expcnt, | ||
unsigned | Lgkmcnt | ||
) |
EncodesVmcnt
,Expcnt
andLgkmcnt
intoWaitcnt for given isaVersion
.
Should not be used on gfx12+, the instruction which needs it is deprecated
Vmcnt
,Expcnt
andLgkmcnt
are encoded as follows:Waitcnt[2:0] =Expcnt
(gfx11+)Waitcnt[3:0] =Vmcnt
(pre-gfx9)Waitcnt[3:0] =Vmcnt
[3:0] (gfx9,10)Waitcnt[6:4] =Expcnt
(pre-gfx11)Waitcnt[9:4] =Lgkmcnt
(gfx11)Waitcnt[11:8] =Lgkmcnt
(pre-gfx10)Waitcnt[13:8] =Lgkmcnt
(gfx10)Waitcnt[15:10] =Vmcnt
(gfx11)Waitcnt[15:14] =Vmcnt
[5:4] (gfx9,10)
Vmcnt
,Expcnt
andLgkmcnt
for given isaVersion
.Definition at line1508 of fileAMDGPUBaseInfo.cpp.
ReferencesencodeExpcnt(),encodeLgkmcnt(),encodeVmcnt(),getWaitcntBitMask(), andllvm::Version.
Referenced byencodeWaitcnt().
Fills Features map with default values for given target GPU.
Definition at line322 of fileTargetParser.cpp.
Referencesllvm::StringRef::empty(),GK_BARTS,GK_CAICOS,GK_CAYMAN,GK_CEDAR,GK_CYPRESS,GK_GFX1010,GK_GFX1011,GK_GFX1012,GK_GFX1013,GK_GFX1030,GK_GFX1031,GK_GFX1032,GK_GFX1033,GK_GFX1034,GK_GFX1035,GK_GFX1036,GK_GFX10_1_GENERIC,GK_GFX10_3_GENERIC,GK_GFX1100,GK_GFX1101,GK_GFX1102,GK_GFX1103,GK_GFX1150,GK_GFX1151,GK_GFX1152,GK_GFX1153,GK_GFX11_GENERIC,GK_GFX1200,GK_GFX1201,GK_GFX12_GENERIC,GK_GFX600,GK_GFX601,GK_GFX602,GK_GFX700,GK_GFX701,GK_GFX702,GK_GFX703,GK_GFX704,GK_GFX705,GK_GFX801,GK_GFX802,GK_GFX803,GK_GFX805,GK_GFX810,GK_GFX900,GK_GFX902,GK_GFX904,GK_GFX906,GK_GFX908,GK_GFX909,GK_GFX90A,GK_GFX90C,GK_GFX940,GK_GFX941,GK_GFX942,GK_GFX950,GK_GFX9_4_GENERIC,GK_GFX9_GENERIC,GK_JUNIPER,GK_NONE,GK_R600,GK_R630,GK_REDWOOD,GK_RS880,GK_RV670,GK_RV710,GK_RV730,GK_RV770,GK_SUMO,GK_TURKS,llvm_unreachable,parseArchAMDGCN(), andparseArchR600().
void llvm::AMDGPU::fillValidArchListAMDGCN | ( | SmallVectorImpl<StringRef > & | Values | ) |
Definition at line218 of fileTargetParser.cpp.
Referencesllvm::CallingConv::C, andllvm::SmallVectorTemplateBase< T, bool >::push_back().
void llvm::AMDGPU::fillValidArchListR600 | ( | SmallVectorImpl<StringRef > & | Values | ) |
Definition at line224 of fileTargetParser.cpp.
Referencesllvm::CallingConv::C, andllvm::SmallVectorTemplateBase< T, bool >::push_back().
Definition at line672 of fileAMDGPUMCExpr.cpp.
ReferencesknownBitsMapHelper(), andtryFoldHelper().
Referenced byllvm::AMDGPUTargetAsmStreamer::EmitAmdhsaKernelDescriptor(), andllvm::AMDGPUTargetAsmStreamer::EmitAMDKernelCodeT().
| static |
Definition at line57 of fileAMDGPUAsanInstrumentation.cpp.
ReferencesCond,llvm::IRBuilderBase::CreateIntrinsic(),llvm::IRBuilderBase::CreateIsNotNull(),llvm::MDBuilder::createUnlikelyBranchWeights(),llvm::IRBuilderBase::GetInsertPoint(),llvm::IRBuilderBase::getInt64Ty(),llvm::IRBuilderBase::SetInsertPoint(), andllvm::SplitBlockAndInsertIfThen().
Referenced byinstrumentAddressImpl().
| static |
Definition at line97 of fileAMDGPUAsanInstrumentation.cpp.
ReferencesAddr,llvm::IRBuilderBase::CreateCall(),llvm::FunctionType::get(),llvm::IRBuilderBase::getVoidTy(),kAsanReportErrorTemplate,llvm::IRBuilderBase::SetInsertPoint(), andllvm::raw_svector_ostream::str().
Referenced byinstrumentAddressImpl().
LLVM_READONLY int llvm::AMDGPU::getAddr64Inst | ( | uint16_t | Opcode | ) |
Referenced byllvm::SIInstrInfo::legalizeOperands().
LLVM_READONLYunsigned llvm::AMDGPU::getAddrSizeMIMGOp | ( | constMIMGBaseOpcodeInfo * | BaseOpcode, |
constMIMGDimInfo * | Dim, | ||
bool | IsA16, | ||
bool | IsG16Supported | ||
) |
Definition at line293 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::AMDGPU::MIMGBaseOpcodeInfo::Coordinates,llvm::divideCeil(),llvm::AMDGPU::MIMGBaseOpcodeInfo::G16,llvm::AMDGPU::MIMGBaseOpcodeInfo::Gradients,llvm::AMDGPU::MIMGBaseOpcodeInfo::LodOrClampOrMip,llvm::AMDGPU::MIMGDimInfo::NumCoords,llvm::AMDGPU::MIMGBaseOpcodeInfo::NumExtraArgs, andllvm::AMDGPU::MIMGDimInfo::NumGradients.
Referenced byllvm::AMDGPUDisassembler::convertMIMGInst(), andllvm::SIInstrInfo::verifyInstruction().
Align llvm::AMDGPU::getAlign | ( | constDataLayout & | DL, |
constGlobalVariable * | GV | ||
) |
Definition at line29 of fileAMDGPUMemoryUtils.cpp.
ReferencesDL,llvm::Value::getPointerAlignment(), andllvm::GlobalValue::getValueType().
Definition at line172 of fileAMDGPUBaseInfo.cpp.
ReferencesgetDefaultAMDHSACodeObjectVersion().
Referenced byllvm::AMDGPUAsmPrinter::doInitialization(),llvm::AMDGPU::HSAMD::MetadataStreamerMsgPackV4::emitKernel(),llvm::AMDGPUSubtarget::getImplicitArgNumBytes(),llvm::AMDGPULegalizerInfo::getSegmentAperture(),llvm::AMDGPULegalizerInfo::legalizeTrapHsaQueuePtr(),llvm::AMDGPULowerKernelAttributesPass::run(),llvm::AMDGPUResourceUsageAnalysis::runOnMachineFunction(), andllvm::AMDGPUDisassembler::setABIVersion().
Definition at line185 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::ELF::ELFABIVERSION_AMDGPU_HSA_V4,llvm::ELF::ELFABIVERSION_AMDGPU_HSA_V5,llvm::ELF::ELFABIVERSION_AMDGPU_HSA_V6, andgetDefaultAMDHSACodeObjectVersion().
Definition at line206 of fileTargetParser.cpp.
ReferencesFEATURE_NONE.
Definition at line212 of fileTargetParser.cpp.
ReferencesFEATURE_NONE.
Definition at line157 of fileTargetParser.cpp.
Referencesllvm::StringRef::drop_back(),llvm::StringRef::empty(),getArchNameAMDGCN(),GK_GFX10_1_GENERIC,GK_GFX10_3_GENERIC,GK_GFX11_GENERIC,GK_GFX12_GENERIC,GK_GFX9_4_GENERIC, andGK_GFX9_GENERIC.
Definition at line176 of fileTargetParser.cpp.
Referenced bygetArchFamilyNameAMDGCN(),llvm::AMDGPUTargetStreamer::getArchNameFromElfMach(), andgetCanonicalArchName().
Definition at line182 of fileTargetParser.cpp.
Referenced byllvm::AMDGPUTargetStreamer::getArchNameFromElfMach(), andgetCanonicalArchName().
std::pair<Register,unsigned > llvm::AMDGPU::getBaseWithConstantOffset | ( | MachineRegisterInfo & | MRI, |
Register | Reg, | ||
GISelKnownBits * | KnownBits =nullptr , | ||
bool | CheckNUW =false | ||
) |
Returns base register and constant offset.
Definition at line26 of fileAMDGPUGlobalISelUtils.cpp.
Referencesassert(),llvm::sampleprof::Base,llvm::getDefIgnoringCopies(),llvm::MIPatternMatch::m_Copy(),llvm::MIPatternMatch::m_GOr(),llvm::MIPatternMatch::m_GPtrAdd(),llvm::MIPatternMatch::m_ICst(),llvm::MIPatternMatch::m_MInstr(),llvm::MIPatternMatch::m_Reg(),llvm::MIPatternMatch::mi_match(),MRI,llvm::MachineInstr::NoUWrap, andllvm::Offset.
Referenced byllvm::AMDGPURegisterBankInfo::applyMappingImpl(),computeIndirectRegIndex(),llvm::AMDGPURegisterBankInfo::setBufferOffsets(), andllvm::AMDGPULegalizerInfo::splitBufferOffsets().
LLVM_READONLY int llvm::AMDGPU::getBasicFromSDWAOp | ( | uint16_t | Opcode | ) |
Referenced byllvm::SIInstrInfo::verifyInstruction().
unsigned llvm::AMDGPU::getBvhcntBitMask | ( | constIsaVersion & | Version | ) |
Version
. Returns 0 for versions that do not support BVHcntDefinition at line1418 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
LLVM_READONLYCanBeVOPD llvm::AMDGPU::getCanBeVOPD | ( | unsigned | Opc | ) |
Definition at line570 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
Referenced byshouldScheduleVOPDAdjacent().
Definition at line313 of fileTargetParser.cpp.
Referencesassert(),getArchNameAMDGCN(),getArchNameR600(),GK_NONE,parseArchAMDGCN(), andparseArchR600().
| static |
Definition at line1521 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
Referenced byencodeLoadcntDscnt(), andencodeStorecntDscnt().
LLVM_READONLY int llvm::AMDGPU::getCommuteOrig | ( | uint16_t | Opcode | ) |
Referenced byllvm::SIInstrInfo::commuteOpcode().
LLVM_READONLY int llvm::AMDGPU::getCommuteRev | ( | uint16_t | Opcode | ) |
Referenced byllvm::SIInstrInfo::commuteOpcode().
Definition at line251 of fileAMDGPUBaseInfo.cpp.
ReferencesAMDHSA_COV4,AMDHSA_COV5,AMDHSA_COV6, andllvm::AMDGPU::ImplicitArg::COMPLETION_ACTION_OFFSET.
unsigned llvm::AMDGPU::getDefaultAMDHSACodeObjectVersion | ( | ) |
Definition at line181 of fileAMDGPUBaseInfo.cpp.
ReferencesDefaultAMDHSACodeObjectVersion.
Referenced bygetAMDHSACodeObjectVersion().
| static |
Definition at line1602 of fileAMDGPUBaseInfo.cpp.
Referenced byllvm::AMDGPU::DepCtr::getDefaultDepCtrEncoding().
Definition at line240 of fileAMDGPUBaseInfo.cpp.
ReferencesAMDHSA_COV4,AMDHSA_COV5,AMDHSA_COV6, andllvm::AMDGPU::ImplicitArg::DEFAULT_QUEUE_OFFSET.
LLVM_READONLY int llvm::AMDGPU::getDPPOp32 | ( | uint16_t | Opcode | ) |
LLVM_READONLY int llvm::AMDGPU::getDPPOp64 | ( | uint16_t | Opcode | ) |
unsigned llvm::AMDGPU::getDscntBitMask | ( | constIsaVersion & | Version | ) |
Version
. Returns 0 for versions that do not support DScntDefinition at line1430 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
CodeObjectVersion | is a value returned bygetAMDHSACodeObjectVersion(). |
Definition at line198 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Triple::AMDHSA,llvm::ELF::ELFABIVERSION_AMDGPU_HSA_V4,llvm::ELF::ELFABIVERSION_AMDGPU_HSA_V5,llvm::ELF::ELFABIVERSION_AMDGPU_HSA_V6, andllvm::report_fatal_error().
Referenced byllvm::AMDGPUTargetELFStreamer::finish().
| static |
Map from a symbolic name for a sendmsg/hwreg asm operand to it's encoding.
Definition at line51 of fileAMDGPUAsmUtils.cpp.
ReferencesName,OPR_ID_UNKNOWN, andOPR_ID_UNSUPPORTED.
Referenced byllvm::AMDGPU::Hwreg::getHwregId(),llvm::AMDGPU::SendMsg::getMsgId(), andllvm::AMDGPU::SendMsg::getMsgOpId().
unsigned llvm::AMDGPU::getExpcntBitMask | ( | constIsaVersion & | Version | ) |
Version
.Definition at line1422 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
Referenced byllvm::AMDGPUInstPrinter::printSWaitCnt().
LLVM_READONLY int llvm::AMDGPU::getFlatScratchInstSSfromSV | ( | uint16_t | Opcode | ) |
Opcode
of an SV (VADDR) form.LLVM_READONLY int llvm::AMDGPU::getFlatScratchInstSTfromSS | ( | uint16_t | Opcode | ) |
Opcode
of an SS (SADDR) form.Referenced byllvm::SIRegisterInfo::buildSpillLoadStore(),llvm::SIRegisterInfo::eliminateFrameIndex(), andgetFlatScratchSpillOpcode().
LLVM_READONLY int llvm::AMDGPU::getFlatScratchInstSVfromSS | ( | uint16_t | Opcode | ) |
Opcode
of an SS (SADDR) form.Referenced byllvm::SIRegisterInfo::buildSpillLoadStore(),getFlatScratchSpillOpcode(), andllvm::SIInstrInfo::moveFlatAddrToVGPR().
LLVM_READONLY int llvm::AMDGPU::getFlatScratchInstSVfromSVS | ( | uint16_t | Opcode | ) |
Opcode
of an SVS (SADDR + VADDR) form.Referenced byllvm::SIRegisterInfo::eliminateFrameIndex().
LLVM_READONLYFPType llvm::AMDGPU::getFPDstSelType | ( | unsigned | Opc | ) |
Definition at line659 of fileAMDGPUBaseInfo.cpp.
ReferencesFP4,FP8,Info, andNone.
Referenced bygetDstSelForwardingOperand().
LLVM_READONLYconstGcnBufferFormatInfo * llvm::AMDGPU::getGcnBufferFormatInfo | ( | uint8_t | BitsPerComp, |
uint8_t | NumComponents, | ||
uint8_t | NumFormat, | ||
constMCSubtargetInfo & | STI | ||
) |
Definition at line2985 of fileAMDGPUBaseInfo.cpp.
ReferencesisGFX10(), andisGFX11Plus().
Referenced bygetBufferFormatWithCompCount().
LLVM_READONLYconstGcnBufferFormatInfo * llvm::AMDGPU::getGcnBufferFormatInfo | ( | uint8_t | Format, |
constMCSubtargetInfo & | STI | ||
) |
Definition at line2998 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Format,isGFX10(), andisGFX11Plus().
LLVM_READONLY int llvm::AMDGPU::getGlobalSaddrOp | ( | uint16_t | Opcode | ) |
Opcode
of a VADDR form.LLVM_READONLY int llvm::AMDGPU::getGlobalVaddrOp | ( | uint16_t | Opcode | ) |
Opcode
of a SADDR form.Referenced byllvm::SIInstrInfo::moveFlatAddrToVGPR().
Definition at line2030 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::CallingConv::AMDGPU_PS, andF.
Referenced bygenerateEndPgm().
Definition at line229 of fileAMDGPUBaseInfo.cpp.
ReferencesAMDHSA_COV4,AMDHSA_COV5,AMDHSA_COV6, andllvm::AMDGPU::ImplicitArg::HOSTCALL_PTR_OFFSET.
LLVM_READONLY int llvm::AMDGPU::getIfAddr64Inst | ( | uint16_t | Opcode | ) |
Check ifOpcode
is an Addr64 opcode.
Opcode
if it is an Addr64 opcode, otherwise -1.Referenced byllvm::SIInstrInfo::legalizeOperands().
constImageDimIntrinsicInfo * llvm::AMDGPU::getImageDimIntrinsicByBaseOpcode | ( | unsigned | BaseOpcode, |
unsigned | Dim | ||
) |
Referenced bysimplifyAMDGCNImageIntrinsic().
constImageDimIntrinsicInfo * llvm::AMDGPU::getImageDimIntrinsicInfo | ( | unsigned | Intr | ) |
Definition at line2026 of fileAMDGPUBaseInfo.cpp.
ReferencesF.
Referenced byllvm::SIMachineFunctionInfo::SIMachineFunctionInfo().
Definition at line2680 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Literal, andSigned.
Referenced bygetInlineEncodingV2F16(),getInlineEncodingV2I16(), andisInlinableLiteralV216().
LLVM_READNONE std::optional<unsigned > llvm::AMDGPU::getInlineEncodingV2BF16 | ( | uint32_t | Literal | ) |
Definition at line2741 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Literal, andSigned.
Referenced byllvm::SITargetLowering::checkAsmConstraintValA(), andisInlinableLiteralV2BF16().
LLVM_READNONE std::optional<unsigned > llvm::AMDGPU::getInlineEncodingV2F16 | ( | uint32_t | Literal | ) |
Definition at line2769 of fileAMDGPUBaseInfo.cpp.
ReferencesgetInlineEncodingV216(), andllvm::Literal.
Referenced byllvm::SITargetLowering::checkAsmConstraintValA(), andisInlinableLiteralV2F16().
LLVM_READNONE std::optional<unsigned > llvm::AMDGPU::getInlineEncodingV2I16 | ( | uint32_t | Literal | ) |
Definition at line2735 of fileAMDGPUBaseInfo.cpp.
ReferencesgetInlineEncodingV216(), andllvm::Literal.
Referenced byllvm::SITargetLowering::checkAsmConstraintValA(), andisInlinableLiteralV2I16().
F's
Name
attribute.Default
if attribute is not present.Default
and emits error if requested value cannot be converted to integer.std::optional< std::pair<unsigned, std::optional<unsigned > > > llvm::AMDGPU::getIntegerPairAttribute | ( | constFunction & | F, |
StringRef | Name, | ||
bool | OnlyFirstRequired =false | ||
) |
F's
Name
attribute in "first[,second]" format ("second" is optional unlessOnlyFirstRequired
is false).std::nullopt
if attribute is not present.std::nullopt
and emits error if one of the requested values cannot be converted to integer, orOnlyFirstRequired
is false and "second" value is not present.Definition at line1341 of fileAMDGPUBaseInfo.cpp.
ReferencesA,llvm::LLVMContext::emitError(),F, andName.
std::pair<unsigned,unsigned > llvm::AMDGPU::getIntegerPairAttribute | ( | constFunction & | F, |
StringRef | Name, | ||
std::pair<unsigned,unsigned > | Default, | ||
bool | OnlyFirstRequired =false | ||
) |
F's
Name
attribute in "first[,second]" format ("second" is optional unlessOnlyFirstRequired
is false).Default
if attribute is not present.Default
and emits error if one of the requested values cannot be converted to integer, orOnlyFirstRequired
is false and "second" value is not present.Definition at line1332 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Default,F,getIntegerPairAttribute(), andName.
Referenced byllvm::AMDGPUMachineFunction::AMDGPUMachineFunction(),llvm::AMDGPUSubtarget::getFlatWorkGroupSizes(),getIntegerPairAttribute(), andllvm::AMDGPUSubtarget::getWavesPerEU().
SmallVector<unsigned > llvm::AMDGPU::getIntegerVecAttribute | ( | constFunction & | F, |
StringRef | Name, | ||
unsigned | Size, | ||
unsigned | DefaultVal =0 | ||
) |
F's
Name
attribute.Definition at line1367 of fileAMDGPUBaseInfo.cpp.
ReferencesA,assert(),llvm::Default,DefaultVal,llvm::LLVMContext::emitError(),llvm::StringRef::empty(),F,Name,Size, andllvm::StringRef::split().
Referenced byllvm::AMDGPUSubtarget::getMaxNumWorkGroups(), andprocessUse().
void llvm::AMDGPU::getInterestingMemoryOperands | ( | Module & | M, |
Instruction * | I, | ||
SmallVectorImpl<InterestingMemoryOperand > & | Interesting | ||
) |
Get all the memory operands from the instruction that needs to be instrumented.
Definition at line220 of fileAMDGPUAsanInstrumentation.cpp.
ReferencesDL,llvm::SmallVectorImpl< T >::emplace_back(),llvm::VectorType::get(),I,Ptr,llvm::Align::value(), andllvm::MaybeAlign::valueOrOne().
Intrinsic::ID llvm::AMDGPU::getIntrinsicID | ( | constMachineInstr & | I | ) |
Return the intrinsic ID for opcodes with the G_AMDGPU_INTRIN_ prefix.
These opcodes have anIntrinsic::ID operand similar to aGIntrinsic. But they are not actual instances of GIntrinsics, so we cannot useGIntrinsic::getIntrinsicID() on them.
Definition at line30 of fileAMDGPUInstrInfo.cpp.
ReferencesI.
Referenced byllvm::AMDGPURegisterBankInfo::applyMappingImpl(),llvm::AMDGPURegisterBankInfo::getInstrMapping(), andllvm::AMDGPUInstructionSelector::select().
AMDGPU::IsaVersion llvm::AMDGPU::getIsaVersion | ( | StringRef | GPU | ) |
Definition at line229 of fileTargetParser.cpp.
ReferencesGK_GFX1010,GK_GFX1011,GK_GFX1012,GK_GFX1013,GK_GFX1030,GK_GFX1031,GK_GFX1032,GK_GFX1033,GK_GFX1034,GK_GFX1035,GK_GFX1036,GK_GFX10_1_GENERIC,GK_GFX10_3_GENERIC,GK_GFX1100,GK_GFX1101,GK_GFX1102,GK_GFX1103,GK_GFX1150,GK_GFX1151,GK_GFX1152,GK_GFX1153,GK_GFX11_GENERIC,GK_GFX1200,GK_GFX1201,GK_GFX12_GENERIC,GK_GFX600,GK_GFX601,GK_GFX602,GK_GFX700,GK_GFX701,GK_GFX702,GK_GFX703,GK_GFX704,GK_GFX705,GK_GFX801,GK_GFX802,GK_GFX803,GK_GFX805,GK_GFX810,GK_GFX900,GK_GFX902,GK_GFX904,GK_GFX906,GK_GFX908,GK_GFX909,GK_GFX90A,GK_GFX90C,GK_GFX940,GK_GFX941,GK_GFX942,GK_GFX950,GK_GFX9_4_GENERIC,GK_GFX9_GENERIC, andparseArchAMDGCN().
Referenced byllvm::AMDGPUTargetAsmStreamer::EmitAmdhsaKernelDescriptor(),llvm::AMDGPU::IsaInfo::getAddressableNumSGPRs(),llvm::AMDGPU::MCKernelDescriptor::getDefaultAmdhsaKernelDescriptor(),llvm::AMDGPU::IsaInfo::getMaxNumSGPRs(),llvm::AMDGPU::IsaInfo::getMinNumSGPRs(),getNSAMaxSize(),llvm::AMDGPU::IsaInfo::getNumExtraSGPRs(),llvm::AMDGPU::IsaInfo::getSGPRAllocGranule(),llvm::AMDGPU::IsaInfo::getTotalNumSGPRs(),initDefaultAMDKernelCodeT(),llvm::AMDGPUInstPrinter::printSWaitCnt(), andllvm::AMDGPU::IsaInfo::AMDGPUTargetID::toString().
unsigned llvm::AMDGPU::getKmcntBitMask | ( | constIsaVersion & | Version | ) |
Version
. Returns 0 for versions that do not support KMcntDefinition at line1434 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
unsigned llvm::AMDGPU::getLdsDwGranularity | ( | constMCSubtargetInfo & | ST | ) |
This
is used to calculate the lds size encoded for PAL metadata 3.0+ which must be defined in terms of bytes.Definition at line3024 of fileAMDGPUBaseInfo.cpp.
Referenced byEmitPALMetadataCommon().
unsigned llvm::AMDGPU::getLgkmcntBitMask | ( | constIsaVersion & | Version | ) |
Version
.Definition at line1426 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
Referenced byllvm::AMDGPUInstPrinter::printSWaitCnt().
unsigned llvm::AMDGPU::getLoadcntBitMask | ( | constIsaVersion & | Version | ) |
Version
. Returns 0 for versions that do not support LOADcntDefinition at line1410 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
LLVM_READONLYbool llvm::AMDGPU::getMAIIsDGEMM | ( | unsigned | Opc | ) |
Returns true if MAI operation is a double precision GEMM.
Definition at line528 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
Referenced byisDGEMM().
LLVM_READONLYbool llvm::AMDGPU::getMAIIsGFX940XDL | ( | unsigned | Opc | ) |
LLVM_READONLY int llvm::AMDGPU::getMaskedMIMGOp | ( | unsigned | Opc, |
unsigned | NewChannels | ||
) |
Definition at line285 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::AMDGPU::MIMGInfo::BaseOpcode,getMIMGInfo(),llvm::AMDGPU::MIMGInfo::MIMGEncoding,llvm::AMDGPU::MIMGInfo::Opcode, andllvm::AMDGPU::MIMGInfo::VAddrDwords.
unsigned llvm::AMDGPU::getMaxNumUserSGPRs | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2146 of fileAMDGPUBaseInfo.cpp.
Referenced byllvm::GCNUserSGPRUsageInfo::allocKernargPreloadSGPRs(),llvm::GCNSubtarget::getMaxNumUserSGPRs(), andllvm::GCNUserSGPRUsageInfo::getNumFreeUserSGPRs().
LLVM_READONLY int llvm::AMDGPU::getMCOpcode | ( | uint16_t | Opcode, |
unsigned | Gen | ||
) |
Definition at line684 of fileAMDGPUBaseInfo.cpp.
Referenced byllvm::SIInstrInfo::pseudoToMCOpcode().
MCRegister llvm::AMDGPU::getMCReg | ( | MCRegister | Reg, |
constMCSubtargetInfo & | STI | ||
) |
IfReg
is a pseudo reg, return the correct hardware register givenSTI
otherwise returnReg
.
Definition at line2349 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Triple::getArch(),llvm::MCSubtargetInfo::getTargetTriple(),MAP_REG2REG,llvm::Triple::r600, andReg.
Referenced byllvm::AMDGPUDisassembler::createRegOperand(), andAMDGPUMCInstLower::lowerOperand().
LLVM_READONLYconstMFMA_F8F6F4_Info * llvm::AMDGPU::getMFMA_F8F6F4_WithFormatArgs | ( | unsigned | CBSZ, |
unsigned | BLGP, | ||
unsigned | F8F8Opcode | ||
) |
Definition at line554 of fileAMDGPUBaseInfo.cpp.
ReferencesmfmaScaleF8F6F4FormatToNumRegs().
Referenced byllvm::AMDGPUDisassembler::convertMAIInst().
LLVM_READONLY int llvm::AMDGPU::getMFMAEarlyClobberOp | ( | uint16_t | Opcode | ) |
Referenced byllvm::SIInstrInfo::convertToThreeAddress(), andllvm::SIInstrInfo::pseudoToMCOpcode().
LLVM_READONLY int llvm::AMDGPU::getMFMASrcCVDstAGPROp | ( | uint16_t | Opcode | ) |
Opcode
of an MFMA which uses VGPRs for srcC/vdst.LLVM_READONLYconstMIMGBaseOpcodeInfo * llvm::AMDGPU::getMIMGBaseOpcode | ( | unsigned | Opc | ) |
Definition at line280 of fileAMDGPUBaseInfo.cpp.
ReferencesgetMIMGBaseOpcodeInfo(),getMIMGInfo(), andInfo.
LLVM_READONLYconstMIMGBaseOpcodeInfo * llvm::AMDGPU::getMIMGBaseOpcodeInfo | ( | unsigned | BaseOpcode | ) |
LLVM_READONLYconstMIMGBiasMappingInfo * llvm::AMDGPU::getMIMGBiasMappingInfo | ( | unsigned | Bias | ) |
Referenced bysimplifyAMDGCNImageIntrinsic().
LLVM_READONLYconstMIMGDimInfo * llvm::AMDGPU::getMIMGDimInfo | ( | unsigned | DimEnum | ) |
LLVM_READONLYconstMIMGDimInfo * llvm::AMDGPU::getMIMGDimInfoByAsmSuffix | ( | StringRef | AsmSuffix | ) |
LLVM_READONLYconstMIMGDimInfo * llvm::AMDGPU::getMIMGDimInfoByEncoding | ( | uint8_t | DimEnc | ) |
LLVM_READONLYconstMIMGG16MappingInfo * llvm::AMDGPU::getMIMGG16MappingInfo | ( | unsigned | G | ) |
LLVM_READONLYconstMIMGInfo * llvm::AMDGPU::getMIMGInfo | ( | unsigned | Opc | ) |
LLVM_READONLYconstMIMGLZMappingInfo * llvm::AMDGPU::getMIMGLZMappingInfo | ( | unsigned | L | ) |
Referenced bysimplifyAMDGCNImageIntrinsic().
LLVM_READONLYconstMIMGMIPMappingInfo * llvm::AMDGPU::getMIMGMIPMappingInfo | ( | unsigned | MIP | ) |
Referenced bysimplifyAMDGCNImageIntrinsic().
LLVM_READONLYconstMIMGOffsetMappingInfo * llvm::AMDGPU::getMIMGOffsetMappingInfo | ( | unsigned | Offset | ) |
Referenced bysimplifyAMDGCNImageIntrinsic().
LLVM_READONLY int llvm::AMDGPU::getMIMGOpcode | ( | unsigned | BaseOpcode, |
unsigned | MIMGEncoding, | ||
unsigned | VDataDwords, | ||
unsigned | VAddrDwords | ||
) |
Definition at line273 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
Referenced byllvm::AMDGPUDisassembler::convertMIMGInst(), andllvm::AMDGPULegalizerInfo::legalizeBVHIntrinsic().
| static |
Definition at line24 of fileAMDGPUAsanInstrumentation.cpp.
ReferencesgetRedzoneSizeForScale().
Referenced bygetRedzoneSizeForGlobal().
LLVM_READONLY int llvm::AMDGPU::getMTBUFBaseOpcode | ( | unsigned | Opc | ) |
Definition at line432 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLY int llvm::AMDGPU::getMTBUFElements | ( | unsigned | Opc | ) |
Definition at line442 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLYbool llvm::AMDGPU::getMTBUFHasSoffset | ( | unsigned | Opc | ) |
Definition at line457 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLYbool llvm::AMDGPU::getMTBUFHasSrsrc | ( | unsigned | Opc | ) |
Definition at line452 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLYbool llvm::AMDGPU::getMTBUFHasVAddr | ( | unsigned | Opc | ) |
Definition at line447 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLY int llvm::AMDGPU::getMTBUFOpcode | ( | unsigned | BaseOpc, |
unsigned | Elements | ||
) |
Definition at line437 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLY int llvm::AMDGPU::getMUBUFBaseOpcode | ( | unsigned | Opc | ) |
Definition at line462 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLY int llvm::AMDGPU::getMUBUFElements | ( | unsigned | Opc | ) |
Definition at line472 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLYbool llvm::AMDGPU::getMUBUFHasSoffset | ( | unsigned | Opc | ) |
Definition at line487 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLYbool llvm::AMDGPU::getMUBUFHasSrsrc | ( | unsigned | Opc | ) |
Definition at line482 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLYbool llvm::AMDGPU::getMUBUFHasVAddr | ( | unsigned | Opc | ) |
Definition at line477 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLYbool llvm::AMDGPU::getMUBUFIsBufferInv | ( | unsigned | Opc | ) |
Definition at line492 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLY int llvm::AMDGPU::getMUBUFOpcode | ( | unsigned | BaseOpc, |
unsigned | Elements | ||
) |
Definition at line467 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLYbool llvm::AMDGPU::getMUBUFTfe | ( | unsigned | Opc | ) |
Definition at line497 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
Referenced byllvm::SITargetLowering::AddMemOpInit().
Definition at line215 of fileAMDGPUBaseInfo.cpp.
ReferencesAMDHSA_COV4,AMDHSA_COV5,AMDHSA_COV6, andllvm::AMDGPU::ImplicitArg::MULTIGRID_SYNC_ARG_OFFSET.
LLVM_READONLY int16_t llvm::AMDGPU::getNamedOperandIdx | ( | uint16_t | Opcode, |
uint16_t | NamedIdx | ||
) |
Referenced byllvm::SITargetLowering::AddMemOpInit(),addSrcModifiersAndSrc(),llvm::SITargetLowering::AdjustInstrPostInstrSelection(),llvm::SIInstrInfo::areLoadsFromSameBasePtr(),llvm::SIInstrInfo::buildShrunkInst(),llvm::SIRegisterInfo::buildSpillLoadStore(),collectVOPModifiers(),llvm::SIInstrInfo::commuteInstructionImpl(),llvm::AMDGPUDisassembler::convertDPP8Inst(),llvm::AMDGPUDisassembler::convertMAIInst(),llvm::AMDGPUDisassembler::convertMIMGInst(),llvm::AMDGPUDisassembler::convertSDWAInst(),llvm::SIInstrInfo::convertToThreeAddress(),llvm::AMDGPUDisassembler::convertTrue16OpSel(),llvm::AMDGPUDisassembler::convertVOP3DPPInst(),cvtVOP3DstOpSelOnly(),decodeAVLdSt(),llvm::AMDGPUDisassembler::decodeVOPDDstYOp(),llvm::SIRegisterInfo::eliminateFrameIndex(),llvm::SIInstrInfo::enforceOperandRCAlignment(),llvm::SIInstrInfo::findCommutedOpIndices(),llvm::SIInstrInfo::foldImmediate(),llvm::SIRegisterInfo::getFrameIndexInstrOffset(),llvm::AMDGPUDisassembler::getInstruction(),llvm::SIInstrInfo::getInstSizeInBytes(),llvm::SIInstrInfo::getMemOperandsWithOffsetWidth(),llvm::SIInstrInfo::getNamedImmOperand(),llvm::SIInstrInfo::getNamedOperand(),llvm::SIInstrInfo::getRegClass(),llvm::SIRegisterInfo::getScratchInstrOffset(),getSrcOperandIndices(),hasAny64BitVGPROperands(),hasNamedOperand(),llvm::SIInstrWorklist::insert(),insertNamedMCOperand(),IsAGPROperand(),llvm::SIInstrInfo::isBufferSMRD(),llvm::SIInstrInfo::isImmOperandLegal(),llvm::SIInstrInfo::isLegalRegOperand(),llvm::SIInstrInfo::isLegalToSwap(),llvm::AMDGPUDisassembler::isMacDPP(),isSendMsgTraceDataOrGDS(),llvm::SIInstrInfo::legalizeOperands(),llvm::SIInstrInfo::legalizeOperandsVOP2(),llvm::SIInstrInfo::legalizeOperandsVOP3(),AMDGPUMCInstLower::lower(),llvm::SIInstrInfo::moveFlatAddrToVGPR(),llvm::SIInstrInfo::moveToVALUImpl(),nodesHaveSameOperandValue(),llvm::SIFrameLowering::processFunctionBeforeFrameFinalized(),llvm::SIInstrInfo::removeModOperands(),updateOperandIfDifferent(), andllvm::SIInstrInfo::verifyInstruction().
| static |
Map from the encoding of a sendmsg/hwreg asm operand to it's name.
Definition at line27 of fileAMDGPUAsmUtils.cpp.
Referenced byllvm::AMDGPU::Hwreg::getHwreg(),llvm::AMDGPU::SendMsg::getMsgName(), andllvm::AMDGPU::SendMsg::getMsgOpName().
unsigned llvm::AMDGPU::getNSAMaxSize | ( | constMCSubtargetInfo & | STI, |
bool | HasSampler | ||
) |
Definition at line2135 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::getCPU(),getIsaVersion(), andllvm::Version.
Referenced byllvm::GCNSubtarget::getNSAMaxSize().
unsigned llvm::AMDGPU::getNumFlatOffsetBits | ( | constMCSubtargetInfo & | ST | ) |
For pre-GFX12 FLAT instructions the offset must be positive; MSB is ignored and forced to zero.
Definition at line2946 of fileAMDGPUBaseInfo.cpp.
ReferencesisGFX10(), andisGFX12().
Referenced byllvm::SIInstrInfo::isLegalFLATOffset(), andllvm::SIInstrInfo::splitFlatOffset().
| inline |
Definition at line1451 of fileAMDGPUBaseInfo.h.
ReferencesgetOperandSize().
| inline |
Definition at line1398 of fileAMDGPUBaseInfo.h.
Referencesllvm_unreachable,OPERAND_INLINE_SPLIT_BARRIER_INT32,OPERAND_KIMM16,OPERAND_KIMM32,OPERAND_REG_IMM_BF16,OPERAND_REG_IMM_BF16_DEFERRED,OPERAND_REG_IMM_FP16,OPERAND_REG_IMM_FP16_DEFERRED,OPERAND_REG_IMM_FP32,OPERAND_REG_IMM_FP32_DEFERRED,OPERAND_REG_IMM_FP64,OPERAND_REG_IMM_INT16,OPERAND_REG_IMM_INT32,OPERAND_REG_IMM_INT64,OPERAND_REG_IMM_V2BF16,OPERAND_REG_IMM_V2FP16,OPERAND_REG_IMM_V2FP32,OPERAND_REG_IMM_V2INT16,OPERAND_REG_IMM_V2INT32,OPERAND_REG_INLINE_AC_BF16,OPERAND_REG_INLINE_AC_FP16,OPERAND_REG_INLINE_AC_FP32,OPERAND_REG_INLINE_AC_FP64,OPERAND_REG_INLINE_AC_INT16,OPERAND_REG_INLINE_AC_INT32,OPERAND_REG_INLINE_AC_V2BF16,OPERAND_REG_INLINE_AC_V2FP16,OPERAND_REG_INLINE_AC_V2INT16,OPERAND_REG_INLINE_C_BF16,OPERAND_REG_INLINE_C_FP16,OPERAND_REG_INLINE_C_FP32,OPERAND_REG_INLINE_C_FP64,OPERAND_REG_INLINE_C_INT16,OPERAND_REG_INLINE_C_INT32,OPERAND_REG_INLINE_C_INT64,OPERAND_REG_INLINE_C_V2BF16,OPERAND_REG_INLINE_C_V2FP16,OPERAND_REG_INLINE_C_V2FP32,OPERAND_REG_INLINE_C_V2INT16,OPERAND_REG_INLINE_C_V2INT32, andllvm::MCOperandInfo::OperandType.
Referenced bygetOperandSize().
Given SizeInBytes of theValue to be instrunmented, Returns the redzone size corresponding to it.
Definition at line28 of fileAMDGPUAsanInstrumentation.cpp.
Referencesassert(), andgetMinRedzoneSizeForGlobal().
| static |
Definition at line18 of fileAMDGPUAsanInstrumentation.cpp.
Referenced bygetMinRedzoneSizeForGlobal().
unsigned llvm::AMDGPU::getRegBitWidth | ( | constMCRegisterClass & | RC | ) |
Get the size in bits of a register from the register classRC
.
Definition at line2588 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCRegisterClass::getID(), andgetRegBitWidth().
unsigned llvm::AMDGPU::getRegBitWidth | ( | constTargetRegisterClass & | RC | ) |
Get the size in bits of a register from the register classRC
.
Definition at line3201 of fileSIRegisterInfo.cpp.
Referencesllvm::TargetRegisterClass::getID(), andgetRegBitWidth().
Referenced byllvm::SIRegisterInfo::buildSpillLoadStore(),llvm::SIInstrInfo::canInsertSelect(),getRegBitWidth(),getRegOperandSize(), andllvm::SIRegisterInfo::getRegSplitParts().
Get the size in bits of a register from the register classRC
.
Definition at line2447 of fileAMDGPUBaseInfo.cpp.
Referencesllvm_unreachable.
unsigned llvm::AMDGPU::getRegOperandSize | ( | constMCRegisterInfo * | MRI, |
constMCInstrDesc & | Desc, | ||
unsigned | OpNo | ||
) |
Get size of register operand.
Definition at line2592 of fileAMDGPUBaseInfo.cpp.
Referencesassert(), andgetRegBitWidth().
unsigned llvm::AMDGPU::getSamplecntBitMask | ( | constIsaVersion & | Version | ) |
Version
. Returns 0 for versions that do not support SAMPLEcntDefinition at line1414 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
LLVM_READONLY int llvm::AMDGPU::getSDWAOp | ( | uint16_t | Opcode | ) |
Deduce the least significant bit aligned shift and mask values for a binary ComplementValue
(as they're defined inSIDefines.h as C_*) as a returned pair<shift, mask>.
That is to sayValue
== ~(mask << shift)
For example, given C_00B848_FWD_PROGRESS (i.e., 0x7FFFFFFF) fromSIDefines.h, this will return the pair as (31,1).
Definition at line27 of fileSIDefinesUtils.h.
LLVM_READONLYbool llvm::AMDGPU::getSMEMIsBuffer | ( | unsigned | Opc | ) |
Definition at line502 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
std::optional< int64_t > llvm::AMDGPU::getSMRDEncodedLiteralOffset32 | ( | constMCSubtargetInfo & | ST, |
int64_t | ByteOffset | ||
) |
Definition at line2936 of fileAMDGPUBaseInfo.cpp.
ReferencesconvertSMRDOffsetUnits(),isCI(), andisDwordAligned().
std::optional< int64_t > llvm::AMDGPU::getSMRDEncodedOffset | ( | constMCSubtargetInfo & | ST, |
int64_t | ByteOffset, | ||
bool | IsBuffer, | ||
bool | HasSOffset =false | ||
) |
ByteOffset
in the SMRD offset field, or std::nullopt if it won't fit. On GFX9 and GFX10 S_LOAD instructions have a signed offset, on other subtargets it is unsigned. S_BUFFER has an unsigned offset for all subtargets.Definition at line2907 of fileAMDGPUBaseInfo.cpp.
Referencesassert(),convertSMRDOffsetUnits(),hasSMEMByteOffset(),hasSMRDSignedImmOffset(),isDwordAligned(),isGFX12Plus(), andisLegalSMRDEncodedUnsignedOffset().
LLVM_READONLY int llvm::AMDGPU::getSOPKOp | ( | uint16_t | Opcode | ) |
LLVM_READONLY int llvm::AMDGPU::getSOPPWithRelaxation | ( | uint16_t | Opcode | ) |
unsigned llvm::AMDGPU::getStorecntBitMask | ( | constIsaVersion & | Version | ) |
Version
. returns 0 for versions that do not support STOREcnt or VScnt. STOREcnt and VScnt are the same counter, the name used depends on the ISA version.Definition at line1438 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
int llvm::AMDGPU::getTotalNumVGPRs | ( | bool | has90AInsts, |
int32_t | ArgNumAGPR, | ||
int32_t | ArgNumVGPR | ||
) |
Definition at line2274 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::alignTo().
LDSUsesInfoTy llvm::AMDGPU::getTransitiveUsesOfLDS | ( | constCallGraph & | CG, |
Module & | M | ||
) |
Definition at line138 of fileAMDGPUMemoryUtils.cpp.
Referencesassert(),llvm::DenseMapBase< DerivedT, KeyT, ValueT, KeyInfoT, BucketT >::contains(),llvm::detail::DenseSetImpl< ValueT, MapTy, ValueInfoT >::contains(),llvm::SmallVectorBase< Size_T >::empty(),F,getUsesOfLDSByFunction(),llvm::detail::DenseSetImpl< ValueT, MapTy, ValueInfoT >::insert(),llvm::SmallPtrSetImpl< PtrType >::insert(),isDynamicLDS(),isKernelLDS(),isNamedBarrier(),llvm::SmallVectorImpl< T >::pop_back_val(),llvm::SmallVectorTemplateBase< T, bool >::push_back(),llvm::report_fatal_error(), andllvm::set_union().
void llvm::AMDGPU::getUsesOfLDSByFunction | ( | constCallGraph & | CG, |
Module & | M, | ||
FunctionVariableMap & | kernels, | ||
FunctionVariableMap & | Functions | ||
) |
Definition at line107 of fileAMDGPUMemoryUtils.cpp.
ReferencesF,I,llvm::DenseMapBase< DerivedT, KeyT, ValueT, KeyInfoT, BucketT >::insert(),isKernelLDS(), andisLDSVariableToLower().
Referenced bygetTransitiveUsesOfLDS().
LLVM_READONLY int llvm::AMDGPU::getVCMPXNoSDstOp | ( | uint16_t | Opcode | ) |
LLVM_READONLY int llvm::AMDGPU::getVCMPXOpFromVCMP | ( | uint16_t | Opcode | ) |
unsigned llvm::AMDGPU::getVmcntBitMask | ( | constIsaVersion & | Version | ) |
Version
.Definition at line1404 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
Referenced byllvm::AMDGPUInstPrinter::printSWaitCnt().
LLVM_READONLYbool llvm::AMDGPU::getVOP1IsSingle | ( | unsigned | Opc | ) |
Definition at line507 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLYbool llvm::AMDGPU::getVOP2IsSingle | ( | unsigned | Opc | ) |
Definition at line512 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLYbool llvm::AMDGPU::getVOP3IsSingle | ( | unsigned | Opc | ) |
Definition at line517 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLY std::pair<unsigned,unsigned > llvm::AMDGPU::getVOPDComponents | ( | unsigned | VOPDOpcode | ) |
Definition at line694 of fileAMDGPUBaseInfo.cpp.
Referenced bygetVOPDInstInfo().
LLVM_READONLYunsigned llvm::AMDGPU::getVOPDEncodingFamily | ( | constMCSubtargetInfo & | ST | ) |
ST
.Definition at line562 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::SIEncodingFamily::GFX11,llvm::SIEncodingFamily::GFX12, andllvm_unreachable.
LLVM_READONLY int llvm::AMDGPU::getVOPDFull | ( | unsigned | OpX, |
unsigned | OpY, | ||
unsigned | EncodingFamily | ||
) |
Definition at line688 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLYVOPD::InstInfo llvm::AMDGPU::getVOPDInstInfo | ( | constMCInstrDesc & | OpX, |
constMCInstrDesc & | OpY | ||
) |
Definition at line790 of fileAMDGPUBaseInfo.cpp.
Referenced byllvm::checkVOPDRegConstraints().
LLVM_READONLYVOPD::InstInfo llvm::AMDGPU::getVOPDInstInfo | ( | unsigned | VOPDOpcode, |
constMCInstrInfo * | InstrInfo | ||
) |
Definition at line794 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::AMDGPU::VOPD::COMPONENT_X,llvm::MCInstrInfo::get(), andgetVOPDComponents().
LLVM_READONLYunsigned llvm::AMDGPU::getVOPDOpcode | ( | unsigned | Opc | ) |
Definition at line577 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
LLVM_READONLY int llvm::AMDGPU::getVOPe32 | ( | uint16_t | Opcode | ) |
Referenced byllvm::SIInstrInfo::hasVALU32BitEncoding().
LLVM_READONLY int llvm::AMDGPU::getVOPe64 | ( | uint16_t | Opcode | ) |
Referenced byllvm::SITargetLowering::EmitInstrWithCustomInserter().
unsigned llvm::AMDGPU::getWaitcntBitMask | ( | constIsaVersion & | Version | ) |
Version
.Definition at line1442 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Version.
Referenced byencodeWaitcnt().
bool llvm::AMDGPU::hasA16 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2118 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
bool llvm::AMDGPU::hasAny64BitVGPROperands | ( | constMCInstrDesc & | OpDesc | ) |
Definition at line3005 of fileAMDGPUBaseInfo.cpp.
ReferencesgetNamedOperandIdx(),llvm::MCInstrDesc::getOpcode(),Idx, andllvm::MCInstrDesc::operands().
Referenced byisDPALU_DPP().
bool llvm::AMDGPU::hasArchitectedFlatScratch | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2254 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced byllvm::AMDGPUTargetAsmStreamer::EmitAmdhsaKernelDescriptor().
bool llvm::AMDGPU::hasDPPSrc1SGPR | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2266 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
bool llvm::AMDGPU::hasG16 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2122 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced byllvm::AMDGPUDisassembler::convertMIMGInst().
bool llvm::AMDGPU::hasGDS | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2131 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced byllvm::AMDGPUDisassembler::getInstruction().
bool llvm::AMDGPU::hasGFX10_3Insts | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2238 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced byllvm::AMDGPU::IsaInfo::getMaxWavesPerEU(), andllvm::AMDGPU::IsaInfo::getVGPRAllocGranule().
unsigned llvm::AMDGPU::hasKernargPreload | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2270 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced byllvm::AMDGPUTargetAsmStreamer::EmitAmdhsaKernelDescriptor(), andllvm::AMDGPUDisassembler::hasKernargPreload().
bool llvm::AMDGPU::hasMAIInsts | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2258 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
bool llvm::AMDGPU::hasMIMG_R128 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2114 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
| inline |
Definition at line400 of fileAMDGPUBaseInfo.h.
ReferencesgetNamedOperandIdx().
Referenced byllvm::SIInstrInfo::areLoadsFromSameBasePtr(),llvm::AMDGPUDisassembler::convertDPP8Inst(),llvm::AMDGPUDisassembler::convertSDWAInst(),llvm::SIInstrInfo::convertToThreeAddress(),llvm::AMDGPUDisassembler::convertVOP3DPPInst(),llvm::AMDGPUDisassembler::convertVOP3PDPPInst(),llvm::AMDGPUDisassembler::convertVOPC64DPPInst(),llvm::AMDGPUDisassembler::convertVOPCDPPInst(),cvtVOP3DstOpSelOnly(),llvm::SIRegisterInfo::eliminateFrameIndex(),getDstSelForwardingOperand(),getFlatScratchSpillOpcode(),llvm::SIInstrInfo::getRegClass(),llvm::SIInstrInfo::hasModifiers(),llvm::AMDGPUDisassembler::isMacDPP(),isVOPD(),llvm::SIInstrInfo::moveToVALUImpl(), andllvm::SITargetLowering::PostISelFolding().
bool llvm::AMDGPU::hasPackedD16 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2126 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature(),isCI(), andisSI().
Referenced byllvm::AMDGPUDisassembler::convertMIMGInst().
| static |
Definition at line2870 of fileAMDGPUBaseInfo.cpp.
ReferencesisGCN3Encoding(), andisGFX10Plus().
Referenced byconvertSMRDOffsetUnits(),getSMRDEncodedOffset(), andisLegalSMRDEncodedUnsignedOffset().
bool llvm::AMDGPU::hasSMRDSignedImmOffset | ( | constMCSubtargetInfo & | ST | ) |
Definition at line163 of fileAMDGPUBaseInfo.cpp.
ReferencesisGFX9Plus().
Referenced bygetSMRDEncodedOffset(), andisLegalSMRDEncodedSignedOffset().
bool llvm::AMDGPU::hasSRAMECC | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2110 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
bool llvm::AMDGPU::hasVOPD | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2262 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced byllvm::AMDGPUDisassembler::decodeMandatoryLiteralConstant().
bool llvm::AMDGPU::hasXNACK | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2106 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
void llvm::AMDGPU::initDefaultAMDKernelCodeT | ( | AMDGPUMCKernelCodeT & | KernelCode, |
constMCSubtargetInfo * | STI | ||
) |
Definition at line1279 of fileAMDGPUBaseInfo.cpp.
ReferencesAMD_CODE_PROPERTY_ENABLE_WAVEFRONT_SIZE32,llvm::AMDGPU::AMDGPUMCKernelCodeT::amd_kernel_code_version_major,llvm::AMDGPU::AMDGPUMCKernelCodeT::amd_kernel_code_version_minor,llvm::AMDGPU::AMDGPUMCKernelCodeT::amd_machine_kind,llvm::AMDGPU::AMDGPUMCKernelCodeT::amd_machine_version_major,llvm::AMDGPU::AMDGPUMCKernelCodeT::amd_machine_version_minor,llvm::AMDGPU::AMDGPUMCKernelCodeT::amd_machine_version_stepping,llvm::AMDGPU::AMDGPUMCKernelCodeT::call_convention,llvm::AMDGPU::AMDGPUMCKernelCodeT::code_properties,llvm::AMDGPU::AMDGPUMCKernelCodeT::compute_pgm_resource_registers,llvm::MCSubtargetInfo::getCPU(),llvm::MCSubtargetInfo::getFeatureBits(),getIsaVersion(),llvm::AMDGPU::AMDGPUMCKernelCodeT::group_segment_alignment,llvm::AMDGPU::AMDGPUMCKernelCodeT::kernarg_segment_alignment,llvm::AMDGPU::AMDGPUMCKernelCodeT::kernel_code_entry_byte_offset,llvm::AMDGPU::AMDGPUMCKernelCodeT::private_segment_alignment,S_00B848_MEM_ORDERED,S_00B848_WGP_MODE,llvm::FeatureBitset::test(),llvm::Version, andllvm::AMDGPU::AMDGPUMCKernelCodeT::wavefront_size.
Referenced byllvm::AMDGPU::AMDGPUMCKernelCodeT::initDefault().
std::pair<FeatureError,StringRef > llvm::AMDGPU::insertWaveSizeFeature | ( | StringRef | GPU, |
constTriple & | T, | ||
StringMap<bool > & | Features | ||
) |
Inserts wave size feature for given GPU into features map.
Definition at line670 of fileTargetParser.cpp.
Referencesllvm::StringMap< ValueTy, AllocatorTy >::count(),llvm::StringRef::empty(),llvm::StringMap< ValueTy, AllocatorTy >::insert(),INVALID_FEATURE_COMBINATION,isWave32Capable(),NO_ERROR, andUNSUPPORTED_TARGET_FEATURE.
void llvm::AMDGPU::instrumentAddress | ( | Module & | M, |
IRBuilder<> & | IRB, | ||
Instruction * | OrigIns, | ||
Instruction * | InsertBefore, | ||
Value * | Addr, | ||
Align | Alignment, | ||
TypeSize | TypeStoreSize, | ||
bool | IsWrite, | ||
Value * | SizeArgument, | ||
bool | UseCalls, | ||
bool | Recover, | ||
int | Scale, | ||
int | Offset | ||
) |
Instrument the memory operand Addr.
Generates report blocks that catch the addressing errors.
Definition at line183 of fileAMDGPUAsanInstrumentation.cpp.
ReferencesAddr,llvm::IRBuilderBase::CreateAdd(),llvm::IRBuilderBase::CreateIntToPtr(),llvm::IRBuilderBase::CreateLShr(),llvm::IRBuilderBase::CreatePtrToInt(),llvm::IRBuilderBase::CreateTypeSize(),llvm::details::FixedOrScalableQuantity< LeafTy, ValueTy >::getFixedValue(),instrumentAddressImpl(),llvm::details::FixedOrScalableQuantity< LeafTy, ValueTy >::isScalable(),llvm::IRBuilderBase::SetInsertPoint(),Size, andllvm::Align::value().
| static |
Definition at line150 of fileAMDGPUAsanInstrumentation.cpp.
ReferencesAddr,llvm::IRBuilderBase::CreateAlignedLoad(),llvm::IRBuilderBase::CreateAnd(),llvm::IRBuilderBase::CreateIntToPtr(),llvm::IRBuilderBase::CreateIsNotNull(),llvm::IRBuilderBase::CreatePtrToInt(),createSlowPathCmp(),genAMDGPUReportBlock(),generateCrashCode(),llvm::IntegerType::get(),llvm::PointerType::get(),llvm::Instruction::getDebugLoc(),llvm::Type::getPointerAddressSpace(),memToShadow(),llvm::Instruction::setDebugLoc(),llvm::IRBuilderBase::SetInsertPoint(),TypeStoreSizeToSizeIndex(), andllvm::Align::value().
Referenced byinstrumentAddress().
Definition at line2815 of fileAMDGPUBaseInfo.cpp.
ReferencesA,llvm::CallingConv::AMDGPU_CS,llvm::CallingConv::AMDGPU_CS_Chain,llvm::CallingConv::AMDGPU_CS_ChainPreserve,llvm::CallingConv::AMDGPU_ES,llvm::CallingConv::AMDGPU_Gfx,llvm::CallingConv::AMDGPU_GS,llvm::CallingConv::AMDGPU_HS,llvm::CallingConv::AMDGPU_KERNEL,llvm::CallingConv::AMDGPU_LS,llvm::CallingConv::AMDGPU_PS,llvm::CallingConv::AMDGPU_VS,CC,F, andllvm::CallingConv::SPIR_KERNEL.
Referenced byadjustInliningThresholdUsingCallee(),llvm::GCNTTIImpl::isSourceOfDivergence(), andllvm::AMDGPUInstrInfo::isUniformMMO().
Definition at line2844 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::CallingConv::AMDGPU_CS,llvm::CallingConv::AMDGPU_CS_Chain,llvm::CallingConv::AMDGPU_CS_ChainPreserve,llvm::CallingConv::AMDGPU_ES,llvm::CallingConv::AMDGPU_Gfx,llvm::CallingConv::AMDGPU_GS,llvm::CallingConv::AMDGPU_HS,llvm::CallingConv::AMDGPU_KERNEL,llvm::CallingConv::AMDGPU_LS,llvm::CallingConv::AMDGPU_PS,llvm::CallingConv::AMDGPU_VS,CC,llvm::CallBase::getCallingConv(),llvm::CallBase::paramHasAttr(), andllvm::CallingConv::SPIR_KERNEL.
LLVM_READNONEbool llvm::AMDGPU::isChainCC | ( | CallingConv::ID | CC | ) |
Definition at line2092 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::CallingConv::AMDGPU_CS_Chain,llvm::CallingConv::AMDGPU_CS_ChainPreserve, andCC.
Referenced bygetCallOpcode(),llvm::AMDGPUCallLowering::handleImplicitCallArguments(),llvm::SITargetLowering::isEligibleForTailCallOptimization(),isModuleEntryFunctionCC(),llvm::SITargetLowering::LowerCall(),llvm::AMDGPUCallLowering::lowerTailCall(), andllvm::SIMachineFunctionInfo::SIMachineFunctionInfo().
bool llvm::AMDGPU::isCI | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2152 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced byllvm::AMDGPU::MTBUFFormat::getNfmtLookupTable(),getSMRDEncodedLiteralOffset32(),hasPackedD16(), andisNotGFX10Plus().
Check is aLoad
is clobbered in its function.
Definition at line389 of fileAMDGPUMemoryUtils.cpp.
Referencesllvm::dbgs(),llvm::MemoryLocation::get(),llvm::MemorySSAWalker::getClobberingMemoryAccess(),llvm::MemorySSA::getWalker(),llvm::SmallSet< T, N, C >::insert(),llvm::MemorySSA::isLiveOnEntryDef(),isReallyAClobber(), andLLVM_DEBUG.
LLVM_READNONEbool llvm::AMDGPU::isCompute | ( | CallingConv::ID | cc | ) |
Definition at line2062 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::CallingConv::AMDGPU_CS, andisGraphics().
Referenced byEmitPALMetadataCommon(),llvm::SIProgramInfo::getPGMRSrc1(),llvm::SIProgramInfo::getPGMRSrc2(),llvm::AMDGPULegalizerInfo::loadInputValue(),llvm::R600InstrInfo::usesTextureCache(), andllvm::R600InstrInfo::usesVertexCache().
Definition at line97 of fileAMDGPUAddrSpace.h.
LLVM_READNONEbool llvm::AMDGPU::isCvt_F32_Fp8_Bf8_e64 | ( | unsigned | Opc | ) |
Definition at line621 of fileAMDGPUBaseInfo.cpp.
bool llvm::AMDGPU::isDPALU_DPP | ( | constMCInstrDesc & | OpDesc | ) |
Definition at line3020 of fileAMDGPUBaseInfo.cpp.
ReferenceshasAny64BitVGPROperands().
Referenced byllvm::SIInstrInfo::verifyInstruction().
Definition at line2894 of fileAMDGPUBaseInfo.cpp.
Referenced byconvertSMRDOffsetUnits(),getSMRDEncodedLiteralOffset32(), andgetSMRDEncodedOffset().
bool llvm::AMDGPU::isDynamicLDS | ( | constGlobalVariable & | GV | ) |
Definition at line56 of fileAMDGPUMemoryUtils.cpp.
ReferencesDL,llvm::GlobalValue::getParent(),llvm::Type::getPointerAddressSpace(),llvm::GlobalValue::getType(),llvm::GlobalValue::getValueType(), andllvm::AMDGPUAS::LOCAL_ADDRESS.
Referenced bygetTransitiveUsesOfLDS(), andisLDSVariableToLower().
LLVM_READNONEbool llvm::AMDGPU::isEntryFunctionCC | ( | CallingConv::ID | CC | ) |
Definition at line2066 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::CallingConv::AMDGPU_CS,llvm::CallingConv::AMDGPU_ES,llvm::CallingConv::AMDGPU_GS,llvm::CallingConv::AMDGPU_HS,llvm::CallingConv::AMDGPU_KERNEL,llvm::CallingConv::AMDGPU_LS,llvm::CallingConv::AMDGPU_PS,llvm::CallingConv::AMDGPU_VS,CC, andllvm::CallingConv::SPIR_KERNEL.
Referenced byllvm::SITargetLowering::CanLowerReturn(),llvm::MCResourceInfo::gatherResourceInfo(),llvm::GCNUserSGPRUsageInfo::GCNUserSGPRUsageInfo(),INITIALIZE_PASS(),isModuleEntryFunctionCC(),llvm::AMDGPULegalizerInfo::loadInputValue(),llvm::AMDGPUCallLowering::lowerFormalArguments(),llvm::SITargetLowering::LowerFormalArguments(),llvm::SITargetLowering::mayBeEmittedAsTailCall(),mustPreserveGV(),recursivelyVisitUsers(), andllvm::SIMachineFunctionInfo::usesAGPRs().
Definition at line91 of fileAMDGPUAddrSpace.h.
Referencesllvm::AMDGPUAS::CONSTANT_ADDRESS,llvm::AMDGPUAS::CONSTANT_ADDRESS_32BIT,llvm::AMDGPUAS::GLOBAL_ADDRESS, andllvm::AMDGPUAS::MAX_AMDGPU_ADDRESS.
Referenced byllvm::SITargetLowering::allowsMisalignedMemoryAccessesImpl(),llvm::AMDGPURegisterBankInfo::applyMappingLoad(),llvm::GCNTTIImpl::isValidAddrSpaceCast(),llvm::GCNTTIImpl::rewriteIntrinsicWithAddressSpace(), andllvm::SITargetLowering::shouldExpandAtomicRMWInIR().
Definition at line86 of fileAMDGPUAddrSpace.h.
Referencesllvm::AMDGPUAS::CONSTANT_ADDRESS,llvm::AMDGPUAS::FLAT_ADDRESS,llvm::AMDGPUAS::GLOBAL_ADDRESS, andllvm::AMDGPUAS::MAX_AMDGPU_ADDRESS.
Referenced byllvm::AMDGPURegisterBankInfo::applyMappingImpl(),llvm::AMDGPURegisterBankInfo::getInstrMappingForLoad(),llvm::AMDGPURegisterBankInfo::getValueMappingForPtr(),llvm::AMDGPUTargetMachine::isNoopAddrSpaceCast(),llvm::GCNTTIImpl::isValidAddrSpaceCast(),llvm::AMDGPULegalizerInfo::legalizeAtomicCmpXChg(),llvm::SITargetLowering::shouldExpandAtomicRMWInIR(), andllvm::GCNTTIImpl::shouldPrefetchAddressSpace().
bool llvm::AMDGPU::isGCN3Encoding | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2226 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced byhasSMEMByteOffset().
LLVM_READNONEbool llvm::AMDGPU::isGenericAtomic | ( | unsigned | Opc | ) |
Definition at line634 of fileAMDGPUBaseInfo.cpp.
Referenced byllvm::SIInstrInfo::getGenericInstructionUniformity().
bool llvm::AMDGPU::isGFX10 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2186 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced bygetGcnBufferFormatInfo(),getNumFlatOffsetBits(),llvm::AMDGPU::MTBUFFormat::getUnifiedFormatName(),llvm::AMDGPUDisassembler::isGFX10(),isGFX10_GFX11(),isGFX10Before1030(),isGFX10Plus(),isGFX8_GFX9_GFX10(),isGFX9_GFX10(),isGFX9_GFX10_GFX11(), andllvm::AMDGPU::MTBUFFormat::isValidUnifiedFormat().
bool llvm::AMDGPU::isGFX10_3_GFX11 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2242 of fileAMDGPUBaseInfo.cpp.
ReferencesisGFX10_BEncoding(), andisGFX12Plus().
bool llvm::AMDGPU::isGFX10_AEncoding | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2230 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
bool llvm::AMDGPU::isGFX10_BEncoding | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2234 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced byisGFX10_3_GFX11(), andisGFX10Before1030().
bool llvm::AMDGPU::isGFX10_GFX11 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2190 of fileAMDGPUBaseInfo.cpp.
bool llvm::AMDGPU::isGFX10Before1030 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2222 of fileAMDGPUBaseInfo.cpp.
ReferencesisGFX10(), andisGFX10_BEncoding().
bool llvm::AMDGPU::isGFX10Plus | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2194 of fileAMDGPUBaseInfo.cpp.
ReferencesisGFX10(), andisGFX11Plus().
Referenced bycreateAMDGPUMCSubtargetInfo(),llvm::AMDGPUAsmPrinter::doFinalization(),generateEndPgm(),llvm::AMDGPU::MTBUFFormat::getDefaultFormatEncoding(),llvm::AMDGPU::IsaInfo::getEUsPerCU(),llvm::AMDGPU::IsaInfo::getLocalMemorySize(),llvm::AMDGPU::IsaInfo::getMaxWavesPerEU(),llvm::AMDGPU::IsaInfo::getMaxWorkGroupsPerCU(),llvm::AMDGPU::IsaInfo::getTotalNumVGPRs(),hasSMEMByteOffset(),llvm::GCNSubtarget::initializeSubtargetDependencies(),llvm::AMDGPUDisassembler::isGFX10Plus(),isGFX9Plus(),llvm::AMDGPU::Exp::isSupportedTgtId(),llvm::AMDGPU::MTBUFFormat::isValidFormatEncoding(), andllvm::AMDGPU::AMDGPUMCKernelCodeT::validate().
bool llvm::AMDGPU::isGFX11 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2198 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced byisGFX10_GFX11(),isGFX11Plus(),isGFX9_GFX10_GFX11(), andllvm::AMDGPULegalizerInfo::legalizeBVHIntrinsic().
bool llvm::AMDGPU::isGFX11Plus | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2202 of fileAMDGPUBaseInfo.cpp.
ReferencesisGFX11(), andisGFX12Plus().
Referenced byllvm::AMDGPU::MTBUFFormat::convertDfmtNfmt2Ufmt(),llvm::AMDGPU::SendMsg::decodeMsg(),llvm::AMDGPUTargetAsmStreamer::EmitCodeEnd(),llvm::AMDGPUTargetELFStreamer::EmitCodeEnd(),getGcnBufferFormatInfo(),llvm::AMDGPU::SendMsg::getMsgIdMask(),llvm::AMDGPU::MTBUFFormat::getUnifiedFormat(),imageIntrinsicOptimizerImpl(),isGFX10Plus(),llvm::AMDGPUDisassembler::isGFX11Plus(),isNotGFX11Plus(),llvm::AMDGPU::Exp::isSupportedTgtId(),llvm::AMDGPU::SendMsg::isValidMsgStream(),llvm::AMDGPULegalizerInfo::legalizeBVHIntrinsic(),llvm::AMDGPU::SendMsg::msgRequiresOp(), andllvm::AMDGPU::SendMsg::msgSupportsStream().
bool llvm::AMDGPU::isGFX12 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2206 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::getFeatureBits().
Referenced bygetNumFlatOffsetBits(), andisGFX12Plus().
bool llvm::AMDGPU::isGFX12Plus | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2210 of fileAMDGPUBaseInfo.cpp.
ReferencesisGFX12().
Referenced byllvm::SIInstrInfo::allowNegativeFlatOffset(),getSMRDEncodedOffset(),isGFX10_3_GFX11(),isGFX11Plus(),llvm::AMDGPUDisassembler::isGFX12Plus(),isLegalSMRDEncodedSignedOffset(),isLegalSMRDEncodedUnsignedOffset(),isNotGFX12Plus(),llvm::AMDGPULegalizerInfo::legalizeBVHIntrinsic(), andllvm::AMDGPU::AMDGPUMCKernelCodeT::validate().
bool llvm::AMDGPU::isGFX8_GFX9_GFX10 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2172 of fileAMDGPUBaseInfo.cpp.
bool llvm::AMDGPU::isGFX8Plus | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2176 of fileAMDGPUBaseInfo.cpp.
ReferencesisGFX9Plus(), andisVI().
bool llvm::AMDGPU::isGFX9 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2160 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced byllvm::AMDGPU::MTBUFFormat::getNfmtLookupTable(),isGFX8_GFX9_GFX10(),llvm::AMDGPUDisassembler::isGFX9(),isGFX9_GFX10(),isGFX9_GFX10_GFX11(),isGFX9Plus(), andisNotGFX10Plus().
bool llvm::AMDGPU::isGFX90A | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2246 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced byllvm::AMDGPUAsmPrinter::doFinalization(),llvm::AMDGPUTargetAsmStreamer::EmitAmdhsaKernelDescriptor(),llvm::AMDGPUTargetAsmStreamer::EmitCodeEnd(),llvm::AMDGPUTargetELFStreamer::EmitCodeEnd(),llvm::AMDGPU::MCKernelDescriptor::getDefaultAmdhsaKernelDescriptor(), andllvm::AMDGPU::IsaInfo::getMaxWavesPerEU().
bool llvm::AMDGPU::isGFX940 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2250 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
bool llvm::AMDGPU::isGFX9_GFX10 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2164 of fileAMDGPUBaseInfo.cpp.
bool llvm::AMDGPU::isGFX9_GFX10_GFX11 | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2168 of fileAMDGPUBaseInfo.cpp.
bool llvm::AMDGPU::isGFX9Plus | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2180 of fileAMDGPUBaseInfo.cpp.
ReferencesisGFX10Plus(), andisGFX9().
Referenced byhasSMRDSignedImmOffset(),isGFX8Plus(),llvm::AMDGPUDisassembler::isGFX9Plus(),isNotGFX9Plus(), andllvm::AMDGPUInstPrinter::printSwizzle().
bool llvm::AMDGPU::isGlobalSegment | ( | constGlobalValue * | GV | ) |
Definition at line1317 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::GlobalValue::getAddressSpace(), andllvm::AMDGPUAS::GLOBAL_ADDRESS.
LLVM_READNONEbool llvm::AMDGPU::isGraphics | ( | CallingConv::ID | cc | ) |
Definition at line2058 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::CallingConv::AMDGPU_Gfx, andisShader().
Referenced byllvm::GCNUserSGPRUsageInfo::GCNUserSGPRUsageInfo(),isCompute(),llvm::SIInstrInfo::legalizeOperands(),llvm::AMDGPUCallLowering::lowerFormalArguments(),llvm::SITargetLowering::LowerFormalArguments(), andllvm::SIMachineFunctionInfo::SIMachineFunctionInfo().
bool llvm::AMDGPU::isGroupSegment | ( | constGlobalValue * | GV | ) |
Definition at line1313 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::GlobalValue::getAddressSpace(), andllvm::AMDGPUAS::LOCAL_ADDRESS.
bool llvm::AMDGPU::isHi16Reg | ( | MCRegister | Reg, |
constMCRegisterInfo & | MRI | ||
) |
Reg
occupies the high 16-bits of a 32-bit register.Definition at line2288 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::AMDGPU::HWEncoding::IS_HI16,MRI, andReg.
Referenced byllvm::SIInstrInfo::copyPhysReg(),cvtVOP3DstOpSelOnly(), andllvm::SIRegisterInfo::SIRegisterInfo().
bool llvm::AMDGPU::isHsaAbi | ( | constMCSubtargetInfo & | STI | ) |
STI
is AMDHSA.Definition at line168 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Triple::AMDHSA,llvm::Triple::getOS(), andllvm::MCSubtargetInfo::getTargetTriple().
| inline |
Is this literal inlinable, and not one of the values intended for floating point values.
Definition at line1458 of fileAMDGPUBaseInfo.h.
Referencesllvm::Literal.
Referenced byllvm::SITargetLowering::checkAsmConstraintVal(),clearUnusedBits(),llvm::SIRegisterInfo::eliminateFrameIndex(),llvm::SIRegisterInfo::isFrameOffsetLegal(),isInlinableLiteral32(),isInlinableLiteral64(),isInlinableLiteralBF16(),isInlinableLiteralFP16(),llvm::SIInstrInfo::isInlineConstant(), andllvm::AMDGPUAsmPrinter::PrintAsmOperand().
LLVM_READNONEbool llvm::AMDGPU::isInlinableLiteral32 | ( | int32_t | Literal, |
bool | HasInv2Pi | ||
) |
Definition at line2616 of fileAMDGPUBaseInfo.cpp.
ReferencesisInlinableIntLiteral(), andllvm::Literal.
Referenced byllvm::SITargetLowering::checkAsmConstraintValA(),llvm::SIRegisterInfo::eliminateFrameIndex(),isInlinableLiteralI16(),isInlineableLiteralOp16(), andllvm::SIInstrInfo::isInlineConstant().
LLVM_READNONEbool llvm::AMDGPU::isInlinableLiteral64 | ( | int64_t | Literal, |
bool | HasInv2Pi | ||
) |
Is this literal inlinable.
Definition at line2599 of fileAMDGPUBaseInfo.cpp.
ReferencesisInlinableIntLiteral(), andllvm::Literal.
Referenced byllvm::SITargetLowering::checkAsmConstraintValA(),llvm::SIInstrInfo::isInlineConstant(), andllvm::SIInstrInfo::isOperandLegal().
LLVM_READNONEbool llvm::AMDGPU::isInlinableLiteralBF16 | ( | int16_t | Literal, |
bool | HasInv2Pi | ||
) |
Definition at line2642 of fileAMDGPUBaseInfo.cpp.
ReferencesisInlinableIntLiteral(), andllvm::Literal.
Referenced byllvm::SITargetLowering::checkAsmConstraintValA(),isInlineableLiteralOp16(), andllvm::SIInstrInfo::isInlineConstant().
LLVM_READNONEbool llvm::AMDGPU::isInlinableLiteralFP16 | ( | int16_t | Literal, |
bool | HasInv2Pi | ||
) |
Definition at line2663 of fileAMDGPUBaseInfo.cpp.
ReferencesisInlinableIntLiteral(), andllvm::Literal.
Referenced byllvm::SITargetLowering::checkAsmConstraintValA(),isInlineableLiteralOp16(), andllvm::SIInstrInfo::isInlineConstant().
LLVM_READNONEbool llvm::AMDGPU::isInlinableLiteralI16 | ( | int32_t | Literal, |
bool | HasInv2Pi | ||
) |
Definition at line2659 of fileAMDGPUBaseInfo.cpp.
ReferencesisInlinableLiteral32(), andllvm::Literal.
Referenced byllvm::SITargetLowering::checkAsmConstraintValA(), andllvm::SIInstrInfo::isInlineConstant().
LLVM_READNONEbool llvm::AMDGPU::isInlinableLiteralV216 | ( | uint32_t | Literal, |
uint8_t | OpType | ||
) |
Definition at line2774 of fileAMDGPUBaseInfo.cpp.
ReferencesgetInlineEncodingV216(),isInlinableLiteralV2BF16(),llvm::Literal,llvm_unreachable,OPERAND_REG_IMM_V2BF16,OPERAND_REG_IMM_V2FP16,OPERAND_REG_IMM_V2INT16,OPERAND_REG_INLINE_AC_V2BF16,OPERAND_REG_INLINE_AC_V2FP16,OPERAND_REG_INLINE_AC_V2INT16,OPERAND_REG_INLINE_C_V2BF16,OPERAND_REG_INLINE_C_V2FP16, andOPERAND_REG_INLINE_C_V2INT16.
LLVM_READNONEbool llvm::AMDGPU::isInlinableLiteralV2BF16 | ( | uint32_t | Literal | ) |
Definition at line2799 of fileAMDGPUBaseInfo.cpp.
ReferencesgetInlineEncodingV2BF16(), andllvm::Literal.
Referenced byisInlinableLiteralV216(), andllvm::SIInstrInfo::isInlineConstant().
LLVM_READNONEbool llvm::AMDGPU::isInlinableLiteralV2F16 | ( | uint32_t | Literal | ) |
Definition at line2804 of fileAMDGPUBaseInfo.cpp.
ReferencesgetInlineEncodingV2F16(), andllvm::Literal.
Referenced byllvm::SIInstrInfo::isInlineConstant().
LLVM_READNONEbool llvm::AMDGPU::isInlinableLiteralV2I16 | ( | uint32_t | Literal | ) |
Definition at line2794 of fileAMDGPUBaseInfo.cpp.
ReferencesgetInlineEncodingV2I16(), andllvm::Literal.
Referenced byllvm::SIInstrInfo::isInlineConstant().
LLVM_READNONEbool llvm::AMDGPU::isInlineValue | ( | unsigned | Reg | ) |
Definition at line2367 of fileAMDGPUBaseInfo.cpp.
ReferencesReg.
Definition at line2981 of fileAMDGPUBaseInfo.cpp.
Referenced byllvm::SIInstrInfo::getGenericInstructionUniformity(),llvm::GCNTTIImpl::isAlwaysUniform(),llvm::AMDGPUTargetLowering::isSDNodeAlwaysUniform(), andisTriviallyUniform().
Definition at line2977 of fileAMDGPUBaseInfo.cpp.
Referenced byllvm::SIInstrInfo::getGenericInstructionUniformity(),llvm::SITargetLowering::isSDNodeSourceOfDivergence(), andllvm::GCNTTIImpl::isSourceOfDivergence().
LLVM_READONLYbool llvm::AMDGPU::isInvalidSingleUseConsumerInst | ( | unsigned | Opc | ) |
LLVM_READONLYbool llvm::AMDGPU::isInvalidSingleUseProducerInst | ( | unsigned | Opc | ) |
| inline |
Definition at line1301 of fileAMDGPUBaseInfo.h.
Referencesllvm::CallingConv::AMDGPU_KERNEL,CC, andllvm::CallingConv::SPIR_KERNEL.
Referenced byllvm::AMDGPUSubtarget::getImplicitArgNumBytes(),isKernelLDS(),llvm::AMDGPULegalizerInfo::legalizeIntrinsic(),llvm::SITargetLowering::LowerFormalArguments(),llvm::AMDGPUCallLowering::lowerReturn(), andllvm::SITargetLowering::LowerReturn().
Definition at line2102 of fileAMDGPUBaseInfo.cpp.
ReferencesisModuleEntryFunctionCC().
Definition at line127 of fileAMDGPUMemoryUtils.cpp.
ReferencesF, andisKernel().
Referenced bygetTransitiveUsesOfLDS(),getUsesOfLDSByFunction(), andremoveFnAttrFromReachable().
bool llvm::AMDGPU::isKImmOperand | ( | constMCInstrDesc & | Desc, |
unsigned | OpNo | ||
) |
Is this a KImm operand?
Definition at line2403 of fileAMDGPUBaseInfo.cpp.
Referencesassert(),OPERAND_KIMM_FIRST, andOPERAND_KIMM_LAST.
bool llvm::AMDGPU::isLDSVariableToLower | ( | constGlobalVariable & | GV | ) |
Definition at line65 of fileAMDGPUMemoryUtils.cpp.
Referencesllvm::GlobalVariable::getInitializer(),llvm::Type::getPointerAddressSpace(),llvm::GlobalValue::getType(),llvm::GlobalVariable::hasInitializer(),llvm::GlobalVariable::isConstant(),isDynamicLDS(), andllvm::AMDGPUAS::LOCAL_ADDRESS.
Referenced byeliminateConstantExprUsesOfLDSFromAllInstructions(), andgetUsesOfLDSByFunction().
| inline |
Definition at line1549 of fileAMDGPUBaseInfo.h.
Referencesllvm::AMDGPU::DPP::ROW_NEWBCAST_FIRST, andllvm::AMDGPU::DPP::ROW_NEWBCAST_LAST.
Referenced byllvm::SIInstrInfo::expandMovDPP64(),llvm::AMDGPULegalizerInfo::legalizeLaneOp(),lowerLaneOp(), andllvm::SIInstrInfo::verifyInstruction().
LLVM_READONLYbool llvm::AMDGPU::isLegalSMRDEncodedSignedOffset | ( | constMCSubtargetInfo & | ST, |
int64_t | EncodedOffset, | ||
bool | IsBuffer | ||
) |
Definition at line2883 of fileAMDGPUBaseInfo.cpp.
ReferenceshasSMRDSignedImmOffset(), andisGFX12Plus().
LLVM_READONLYbool llvm::AMDGPU::isLegalSMRDEncodedUnsignedOffset | ( | constMCSubtargetInfo & | ST, |
int64_t | EncodedOffset | ||
) |
Definition at line2874 of fileAMDGPUBaseInfo.cpp.
ReferenceshasSMEMByteOffset(), andisGFX12Plus().
Referenced bygetSMRDEncodedOffset().
bool llvm::AMDGPU::isLegalSMRDImmOffset | ( | constMCSubtargetInfo & | ST, |
int64_t | ByteOffset | ||
) |
ByteOffset
should be the offset in bytes and not the encoded offset.LLVM_READNONEbool llvm::AMDGPU::isMAC | ( | unsigned | Opc | ) |
Definition at line586 of fileAMDGPUBaseInfo.cpp.
Referenced byllvm::AMDGPUDisassembler::getInstruction().
LLVM_READNONEbool llvm::AMDGPU::isModuleEntryFunctionCC | ( | CallingConv::ID | CC | ) |
Definition at line2083 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::CallingConv::AMDGPU_Gfx,CC,isChainCC(), andisEntryFunctionCC().
Referenced byisKernelCC().
TargetExtType * llvm::AMDGPU::isNamedBarrier | ( | constGlobalVariable & | GV | ) |
Definition at line34 of fileAMDGPUMemoryUtils.cpp.
Referencesllvm::GlobalValue::getValueType().
Referenced byllvm::AMDGPUMachineFunction::allocateLDSGlobal(),getTransitiveUsesOfLDS(),llvm::AMDGPULegalizerInfo::legalizeGlobalValue(), andllvm::AMDGPUTargetLowering::LowerGlobalAddress().
bool llvm::AMDGPU::isNotGFX10Plus | ( | constMCSubtargetInfo & | STI | ) |
bool llvm::AMDGPU::isNotGFX11Plus | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2214 of fileAMDGPUBaseInfo.cpp.
ReferencesisGFX11Plus().
bool llvm::AMDGPU::isNotGFX12Plus | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2212 of fileAMDGPUBaseInfo.cpp.
ReferencesisGFX12Plus().
bool llvm::AMDGPU::isNotGFX9Plus | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2184 of fileAMDGPUBaseInfo.cpp.
ReferencesisGFX9Plus().
LLVM_READNONEbool llvm::AMDGPU::isPermlane16 | ( | unsigned | Opc | ) |
Definition at line610 of fileAMDGPUBaseInfo.cpp.
bool llvm::AMDGPU::isReadOnlySegment | ( | constGlobalValue * | GV | ) |
Definition at line1321 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::AMDGPUAS::CONSTANT_ADDRESS,llvm::AMDGPUAS::CONSTANT_ADDRESS_32BIT, andllvm::GlobalValue::getAddressSpace().
Referenced byllvm::AMDGPUTargetObjectFile::SelectSectionForGlobal().
Given aDef
clobbering a load fromPtr
according to the MSSA check if this is actually a memory update or an artificial clobber to facilitate ordering constraints.
Definition at line350 of fileAMDGPUMemoryUtils.cpp.
ReferencesI,II,llvm::AAResults::isNoAlias(), andPtr.
Referenced byisClobberedInFunction().
bool llvm::AMDGPU::isSGPR | ( | MCRegister | Reg, |
constMCRegisterInfo * | TRI | ||
) |
Is Reg - scalar register.
Definition at line2281 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCRegisterClass::contains(),Reg, andTRI.
LLVM_READNONEbool llvm::AMDGPU::isShader | ( | CallingConv::ID | cc | ) |
Definition at line2041 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::CallingConv::AMDGPU_CS,llvm::CallingConv::AMDGPU_CS_Chain,llvm::CallingConv::AMDGPU_CS_ChainPreserve,llvm::CallingConv::AMDGPU_ES,llvm::CallingConv::AMDGPU_GS,llvm::CallingConv::AMDGPU_HS,llvm::CallingConv::AMDGPU_LS,llvm::CallingConv::AMDGPU_PS, andllvm::CallingConv::AMDGPU_VS.
Referenced byllvm::SIModeRegisterDefaults::getDefaultForCallingConv(),isGraphics(),llvm::GCNSubtarget::isMesaGfxShader(),llvm::AMDGPUSubtarget::isMesaKernel(),llvm::R600TargetLowering::LowerFormalArguments(),llvm::AMDGPUCallLowering::lowerReturn(),llvm::SITargetLowering::LowerReturn(), andreservePrivateMemoryRegs().
bool llvm::AMDGPU::isSI | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2148 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced byllvm::AMDGPU::MTBUFFormat::getNfmtLookupTable(),hasPackedD16(), andisNotGFX10Plus().
bool llvm::AMDGPU::isSISrcFPOperand | ( | constMCInstrDesc & | Desc, |
unsigned | OpNo | ||
) |
Is this floating-point operand?
Definition at line2410 of fileAMDGPUBaseInfo.cpp.
Referencesassert(),OPERAND_REG_IMM_FP16,OPERAND_REG_IMM_FP16_DEFERRED,OPERAND_REG_IMM_FP32,OPERAND_REG_IMM_FP32_DEFERRED,OPERAND_REG_IMM_FP64,OPERAND_REG_IMM_V2FP16,OPERAND_REG_IMM_V2FP32,OPERAND_REG_INLINE_AC_FP16,OPERAND_REG_INLINE_AC_FP32,OPERAND_REG_INLINE_AC_FP64,OPERAND_REG_INLINE_AC_V2FP16,OPERAND_REG_INLINE_C_FP16,OPERAND_REG_INLINE_C_FP32,OPERAND_REG_INLINE_C_FP64,OPERAND_REG_INLINE_C_V2FP16, andOPERAND_REG_INLINE_C_V2FP32.
bool llvm::AMDGPU::isSISrcInlinableOperand | ( | constMCInstrDesc & | Desc, |
unsigned | OpNo | ||
) |
Does this operand support only inlinable literals?
Definition at line2436 of fileAMDGPUBaseInfo.cpp.
Referencesassert(),OPERAND_REG_INLINE_AC_FIRST,OPERAND_REG_INLINE_AC_LAST,OPERAND_REG_INLINE_C_FIRST, andOPERAND_REG_INLINE_C_LAST.
bool llvm::AMDGPU::isSISrcOperand | ( | constMCInstrDesc & | Desc, |
unsigned | OpNo | ||
) |
Is this anAMDGPU specific source operand? These include registers, inline constants, literals and mandatory literals (KImm).
Definition at line2396 of fileAMDGPUBaseInfo.cpp.
Referencesassert(),OPERAND_SRC_FIRST, andOPERAND_SRC_LAST.
Referenced byllvm::SIInstrInfo::isImmOperandLegal(), andllvm::SIInstrInfo::isOperandLegal().
| static |
Definition at line1614 of fileAMDGPUBaseInfo.cpp.
Referenced byllvm::AMDGPU::DepCtr::isSymbolicDepCtrEncoding().
LLVM_READONLYbool llvm::AMDGPU::isTrue16Inst | ( | unsigned | Opc | ) |
Definition at line654 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
Referenced byllvm::SIInstrInfo::moveToVALUImpl().
LLVM_READNONEbool llvm::AMDGPU::isValid32BitLiteral | ( | uint64_t | Val, |
bool | IsFP64 | ||
) |
Definition at line2808 of fileAMDGPUBaseInfo.cpp.
Referenced byllvm::SIInstrInfo::isOperandLegal(), andllvm::AMDGPUDAGToDAGISel::Select().
bool llvm::AMDGPU::isVI | ( | constMCSubtargetInfo & | STI | ) |
Definition at line2156 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::MCSubtargetInfo::hasFeature().
Referenced byllvm::AMDGPU::MTBUFFormat::getNfmtLookupTable(),isGFX8_GFX9_GFX10(),isGFX8Plus(), andisNotGFX10Plus().
LLVM_READONLYbool llvm::AMDGPU::isVOPC64DPP | ( | unsigned | Opc | ) |
Definition at line522 of fileAMDGPUBaseInfo.cpp.
Referenced byllvm::AMDGPUDisassembler::getInstruction().
LLVM_READONLYbool llvm::AMDGPU::isVOPCAsmOnly | ( | unsigned | Opc | ) |
Definition at line526 of fileAMDGPUBaseInfo.cpp.
LLVM_READONLYbool llvm::AMDGPU::isVOPD | ( | unsigned | Opc | ) |
Definition at line582 of fileAMDGPUBaseInfo.cpp.
ReferenceshasNamedOperand().
Referenced bygetSrcOperandIndices().
constD16ImageDimIntrinsic * llvm::AMDGPU::lookupD16ImageDimIntrinsic | ( | unsigned | Intr | ) |
constRsrcIntrinsic * llvm::AMDGPU::lookupRsrcIntrinsic | ( | unsigned | Intr | ) |
LLVM_READONLYunsigned llvm::AMDGPU::mapWMMA2AddrTo3AddrOpcode | ( | unsigned | Opc | ) |
Definition at line671 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
Referenced byllvm::SIInstrInfo::convertToThreeAddress().
LLVM_READONLYunsigned llvm::AMDGPU::mapWMMA3AddrTo2AddrOpcode | ( | unsigned | Opc | ) |
Definition at line676 of fileAMDGPUBaseInfo.cpp.
ReferencesInfo.
| inline |
Provided with theMCExpr *Val
, uint32Mask
andShift
, will return the right shifted and masked, in said order of operations,MCExpr * created within theMCContextCtx
.
For example, givenMCExpr *Val, Mask == 0xf, Shift == 6 the returnedMCExpr
Definition at line63 of fileSIDefinesUtils.h.
Referencesllvm::MCConstantExpr::create(),llvm::MCBinaryExpr::createAnd(), andllvm::MCBinaryExpr::createLShr().
| inline |
Provided with theMCExpr *Val
, uint32Mask
andShift
, will return the masked and left shifted, in said order of operations,MCExpr * created within theMCContextCtx
.
For example, givenMCExpr *Val, Mask == 0xf, Shift == 6 the returnedMCExpr
Definition at line44 of fileSIDefinesUtils.h.
Referencesllvm::MCConstantExpr::create(),llvm::MCBinaryExpr::createAnd(), andllvm::MCBinaryExpr::createShl().
Referenced byllvm::AMDGPU::AMDGPUMCKernelCodeT::EmitKernelCodeT().
LLVM_READNONEMCRegister llvm::AMDGPU::mc2PseudoReg | ( | MCRegister | Reg | ) |
Convert hardware registerReg
to a pseudo register.
Definition at line2365 of fileAMDGPUBaseInfo.cpp.
ReferencesMAP_REG2REG.
Referenced bycheckWriteLane().
| static |
Definition at line139 of fileAMDGPUAsanInstrumentation.cpp.
Referencesllvm::IRBuilderBase::CreateAdd(), andllvm::IRBuilderBase::CreateLShr().
Referenced byinstrumentAddressImpl().
LLVM_READNONEuint8_t llvm::AMDGPU::mfmaScaleF8F6F4FormatToNumRegs | ( | unsigned | EncodingVal | ) |
Definition at line538 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::AMDGPU::MFMAScaleFormats::FP4_E2M1,llvm::AMDGPU::MFMAScaleFormats::FP6_E2M3,llvm::AMDGPU::MFMAScaleFormats::FP6_E3M2,llvm::AMDGPU::MFMAScaleFormats::FP8_E4M3,llvm::AMDGPU::MFMAScaleFormats::FP8_E5M2, andllvm_unreachable.
Referenced bygetMFMA_F8F6F4_WithFormatArgs().
AMDGPU::GPUKind llvm::AMDGPU::parseArchAMDGCN | ( | StringRef | CPU | ) |
Definition at line188 of fileTargetParser.cpp.
Referencesllvm::CallingConv::C.
Referenced byfillAMDGPUFeatureMap(),getCanonicalArchName(),llvm::AMDGPUTargetStreamer::getElfMach(),getIsaVersion(), andisWave32Capable().
AMDGPU::GPUKind llvm::AMDGPU::parseArchR600 | ( | StringRef | CPU | ) |
Definition at line197 of fileTargetParser.cpp.
Referencesllvm::CallingConv::C.
Referenced byfillAMDGPUFeatureMap(),getCanonicalArchName(), andllvm::AMDGPUTargetStreamer::getElfMach().
void llvm::AMDGPU::printAMDGPUMCExpr | ( | constMCExpr * | Expr, |
raw_ostream & | OS, | ||
constMCAsmInfo * | MAI | ||
) |
Definition at line681 of fileAMDGPUMCExpr.cpp.
ReferencesOS, andllvm::MCExpr::print().
Referenced byllvm::AMDGPUTargetAsmStreamer::EmitAmdhsaKernelDescriptor(), andllvm::AMDGPUTargetAsmStreamer::EmitAMDKernelCodeT().
void llvm::AMDGPU::removeFnAttrFromReachable | ( | CallGraph & | CG, |
Function * | KernelRoot, | ||
ArrayRef<StringRef > | FnAttrs | ||
) |
Strip FnAttr attribute from any functions where we may have introduced its use.
Definition at line306 of fileAMDGPUMemoryUtils.cpp.
Referencesassert(),llvm::SmallVectorBase< Size_T >::empty(),F,llvm::CallGraph::getExternalCallingNode(),llvm::Function::getFunction(),llvm::SmallPtrSetImpl< PtrType >::insert(),isKernelLDS(),llvm::SmallVectorImpl< T >::pop_back_val(),llvm::SmallVectorTemplateBase< T, bool >::push_back(), andllvm::Function::removeFnAttr().
TT
, false otherwise.Definition at line1327 of fileAMDGPUBaseInfo.cpp.
Referencesllvm::Triple::r600.
Referenced byllvm::AMDGPUTargetObjectFile::SelectSectionForGlobal(), andllvm::SITargetLowering::shouldEmitFixup().
| static |
Definition at line52 of fileAMDGPUAsanInstrumentation.cpp.
Referencesllvm::countr_zero().
Referenced byinstrumentAddressImpl().
| staticconstexpr |
Offset of nonstandard values for llvm.get.rounding results from the largest supported mode.
Definition at line135 of fileSIModeRegisterDefaults.h.
Referenced bydecodeFltRoundToHWConversionTable(),decodeIndexFltRoundConversionTable(),encodeFltRoundsTable(),encodeFltRoundsToHWTable(), andencodeFltRoundsToHWTableSame().
| staticconstexpr |
Offset in mode register of f32 rounding mode.
Definition at line138 of fileSIModeRegisterDefaults.h.
Referenced bygetModeRegisterRoundMode().
| staticconstexpr |
Offset in mode register of f64/f16 rounding mode.
Definition at line141 of fileSIModeRegisterDefaults.h.
Referenced bygetModeRegisterRoundMode().
Definition at line86 of fileSIModeRegisterDefaults.cpp.
Referenced bydecodeIndexFltRoundConversionTable(), andllvm::SITargetLowering::lowerGET_ROUNDING().
Definition at line200 of fileSIModeRegisterDefaults.cpp.
Referenced bydecodeFltRoundToHW(),decodeFltRoundToHWConversionTable(),decodeFltRoundToHWConversionTable(), andllvm::SITargetLowering::lowerSET_ROUNDING().
const int llvm::AMDGPU::OPR_ID_DUPLICATE = -3 |
Definition at line25 of fileAMDGPUAsmUtils.h.
Referenced byencodeCustomOperand().
const int llvm::AMDGPU::OPR_ID_UNKNOWN = -1 |
Definition at line23 of fileAMDGPUAsmUtils.h.
Referenced byencodeCustomOperand(), andgetEncodingFromOperandTable().
const int llvm::AMDGPU::OPR_ID_UNSUPPORTED = -2 |
Definition at line24 of fileAMDGPUAsmUtils.h.
Referenced byencodeCustomOperand(), andgetEncodingFromOperandTable().
const int llvm::AMDGPU::OPR_VAL_INVALID = -4 |
Definition at line26 of fileAMDGPUAsmUtils.h.
Referenced byencodeCustomOperandVal().
Definition at line1594 of fileSIInstrInfo.h.
Referenced byllvm::SIInstrInfo::getDefaultRsrcDataFormat().
Definition at line1595 of fileSIInstrInfo.h.
Referenced byllvm::SIInstrInfo::getScratchRsrcWords23().
Definition at line1596 of fileSIInstrInfo.h.
Referenced byllvm::SIInstrInfo::getScratchRsrcWords23().
Definition at line1597 of fileSIInstrInfo.h.
Referenced byllvm::SIInstrInfo::getScratchRsrcWords23().