org.apache.spark.dict

类 NGlobalDictionary

java.lang.Object

org.apache.spark.dict.NGlobalDictionary

所有已实现的接口:

Serializable

public class NGlobalDictionary
extends Object
implements Serializable

另请参阅:

序列化表格

字段概要

字段

限定符和类型	字段和说明
protected static org.slf4j.Logger	logger
static String	SEPARATOR

构造器概要

构造器

构造器和说明
NGlobalDictionary(String dictParams)
NGlobalDictionary(String project, String sourceTable, String sourceColumn, String baseDir)

方法概要

限定符和类型	方法和说明
NBucketDictionary	createNewBucketDictionary()
int	getBucketSizeOrDefault(int defaultSize)
NGlobalDictMetaInfo	getMetaInfo()
String	getResourceDir()
boolean	isFirst()
NBucketDictionary	loadBucketDictionary(int bucketId)
void	prepareWrite()
void	setFirst(boolean first)
void	writeMetaDict(int bucketSize, int maxVersions, long versionTTL)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

logger

protected static final org.slf4j.Logger logger

SEPARATOR

public static final String SEPARATOR

另请参阅:

常量字段值

构造器详细资料

NGlobalDictionary

public NGlobalDictionary(String project,
                         String sourceTable,
                         String sourceColumn,
                         String baseDir)
                  throws IOException

抛出:

IOException

NGlobalDictionary

public NGlobalDictionary(String dictParams)
                  throws IOException

抛出:

IOException

方法详细资料

getResourceDir

public String getResourceDir()

loadBucketDictionary

public NBucketDictionary loadBucketDictionary(int bucketId)
                                       throws IOException

抛出:

IOException

createNewBucketDictionary

public NBucketDictionary createNewBucketDictionary()

prepareWrite

public void prepareWrite()
                  throws IOException

抛出:

IOException

writeMetaDict

public void writeMetaDict(int bucketSize,
                          int maxVersions,
                          long versionTTL)
                   throws IOException

抛出:

IOException

getMetaInfo

public NGlobalDictMetaInfo getMetaInfo()
                                throws IOException

抛出:

IOException

getBucketSizeOrDefault

public int getBucketSizeOrDefault(int defaultSize)

isFirst

public boolean isFirst()

setFirst

public void setFirst(boolean first)