org.apache.parquet.column.values.dictionary

Class DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter

java.lang.Object

org.apache.parquet.column.values.ValuesWriter

org.apache.parquet.column.values.dictionary.DictionaryValuesWriter

org.apache.parquet.column.values.dictionary.DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter

All Implemented Interfaces:

RequiresFallback

Direct Known Subclasses:

DictionaryValuesWriter.PlainFixedLenArrayDictionaryValuesWriter

Enclosing class:

DictionaryValuesWriter

public static class DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter
extends DictionaryValuesWriter

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.parquet.column.values.dictionary.DictionaryValuesWriter

DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter, DictionaryValuesWriter.PlainDoubleDictionaryValuesWriter, DictionaryValuesWriter.PlainFixedLenArrayDictionaryValuesWriter, DictionaryValuesWriter.PlainFloatDictionaryValuesWriter, DictionaryValuesWriter.PlainIntegerDictionaryValuesWriter, DictionaryValuesWriter.PlainLongDictionaryValuesWriter

Field Summary

Fields

Modifier and Type	Field and Description
protected it.unimi.dsi.fastutil.objects.Object2IntMap<Binary>	binaryDictionaryContent

Fields inherited from class org.apache.parquet.column.values.dictionary.DictionaryValuesWriter

dictionaryByteSize, dictionaryTooBig, encodedValues, encodingForDictionaryPage, lastUsedDictionaryByteSize, lastUsedDictionarySize, maxDictionaryByteSize

Constructor Summary

Constructors

Constructor and Description
DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter(int maxDictionaryByteSize, Encoding encodingForDataPage, Encoding encodingForDictionaryPage)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	clearDictionaryContent() clear/free the underlying dictionary content
protected static Binary	copy(Binary binary)
DictionaryPage	createDictionaryPage()
void	fallBackDictionaryEncodedData(ValuesWriter writer)
int	getDictionarySize()
void	writeBytes(Binary v)

Methods inherited from class org.apache.parquet.column.values.dictionary.DictionaryValuesWriter

dictPage, fallBackAllValuesTo, getAllocatedSize, getBufferedSize, getBytes, getEncoding, isCompressionSatisfying, memUsageString, reset, resetDictionary, shouldFallBack

Methods inherited from class org.apache.parquet.column.values.ValuesWriter

writeBoolean, writeByte, writeDouble, writeFloat, writeInteger, writeLong

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

binaryDictionaryContent

protected it.unimi.dsi.fastutil.objects.Object2IntMap<Binary> binaryDictionaryContent

Constructor Detail

DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter

public DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter(int maxDictionaryByteSize,
                                                        Encoding encodingForDataPage,
                                                        Encoding encodingForDictionaryPage)

Parameters:

maxDictionaryByteSize -

Method Detail

writeBytes

public void writeBytes(Binary v)

Overrides:

writeBytes in class ValuesWriter

createDictionaryPage

public DictionaryPage createDictionaryPage()

Overrides:

createDictionaryPage in class ValuesWriter

Returns:

the dictionary page or null if not dictionary based

getDictionarySize

public int getDictionarySize()

Specified by:

getDictionarySize in class DictionaryValuesWriter

Returns:

size in items

clearDictionaryContent

protected void clearDictionaryContent()

Description copied from class: DictionaryValuesWriter

clear/free the underlying dictionary content

Specified by:

clearDictionaryContent in class DictionaryValuesWriter

fallBackDictionaryEncodedData

public void fallBackDictionaryEncodedData(ValuesWriter writer)

Specified by:

fallBackDictionaryEncodedData in class DictionaryValuesWriter

copy

protected static Binary copy(Binary binary)