Discussion:
[leveldb] leveldb generating tiny sst file
孙伟
2015-07-27 15:47:45 UTC
Permalink
Hi,

i set



*kTargetFileSize to 32M, so the sst file should be 32M.when i insert a lot
of data to leveldb, i found a lot of sst file is 32Mand a great number of
file is 1k, 2k, or 16kwhat's the problem, can someone tell how to compact
the small sst into large sst file?*
--
You received this message because you are subscribed to the Google Groups "leveldb" group.
To unsubscribe from this group and stop receiving emails from it, send an email to leveldb+***@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
孙伟
2015-08-05 04:29:37 UTC
Permalink
any one can give me some tips on how to emerge this small files,
Thanks a lot!

圚 2015幎7月27日星期䞀 UTC+8䞋午11:47:45孙䌟写道
Post by 孙伟
Hi,
i set
*kTargetFileSize to 32M, so the sst file should be 32M.when i insert a lot
of data to leveldb, i found a lot of sst file is 32Mand a great number of
file is 1k, 2k, or 16kwhat's the problem, can someone tell how to compact
the small sst into large sst file?*
--
You received this message because you are subscribed to the Google Groups "leveldb" group.
To unsubscribe from this group and stop receiving emails from it, send an email to leveldb+***@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Edouard Alligand
2015-08-06 12:49:23 UTC
Permalink
Why would you want to change kTargetFileSize? Also keep in mind it's the
"target" size.
Post by 孙伟
any one can give me some tips on how to emerge this small files,
Thanks a lot!
圚 2015幎7月27日星期䞀 UTC+8䞋午11:47:45孙䌟写道
Post by 孙伟
Hi,
i set
*kTargetFileSize to 32M, so the sst file should be 32M.when i insert a
lot of data to leveldb, i found a lot of sst file is 32Mand a great number
of file is 1k, 2k, or 16kwhat's the problem, can someone tell how to
compact the small sst into large sst file?*
--
You received this message because you are subscribed to the Google Groups "leveldb" group.
To unsubscribe from this group and stop receiving emails from it, send an
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "leveldb" group.
To unsubscribe from this group and stop receiving emails from it, send an email to leveldb+***@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Robert Escriva
2015-08-06 12:55:06 UTC
Permalink
The target size is approximately the minimum size of a file. Increasing it will not create small files. I suspect what's going on here is either compression is enabled and doing a really good job, or more likely, the database is being opened and closed frequently.
Post by Edouard Alligand
Why would you want to change kTargetFileSize? Also keep in mind it's the
"target" size.
Post by 孙伟
any one can give me some tips on how to emerge this small files,
Thanks a lot!
在 2015年7月27日星期一 UTC+8下午11:47:45,孙伟写道:
Post by 孙伟
Hi,
i set
*kTargetFileSize to 32M, so the sst file should be 32M.when i insert
a
Post by 孙伟
Post by 孙伟
lot of data to leveldb, i found a lot of sst file is 32Mand a great
number
Post by 孙伟
Post by 孙伟
of file is 1k, 2k, or 16kwhat's the problem, can someone tell how to
compact the small sst into large sst file?*
--
You received this message because you are subscribed to the Google
Groups
Post by 孙伟
"leveldb" group.
To unsubscribe from this group and stop receiving emails from it,
send an
Post by 孙伟
For more options, visit https://groups.google.com/d/optout.
--
Sent from my phone. Please excuse my brevity.
--
You received this message because you are subscribed to the Google Groups "leveldb" group.
To unsubscribe from this group and stop receiving emails from it, send an email to leveldb+***@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
陈宗志
2015-09-21 02:52:52 UTC
Permalink
I think the small sst files don't affect the performance.

you can write a simple compact program to make the small sst into large sst
file..
Post by 孙伟
Hi,
i set
*kTargetFileSize to 32M, so the sst file should be 32M.when i insert a lot
of data to leveldb, i found a lot of sst file is 32Mand a great number of
file is 1k, 2k, or 16kwhat's the problem, can someone tell how to compact
the small sst into large sst file?*
--
You received this message because you are subscribed to the Google Groups "leveldb" group.
To unsubscribe from this group and stop receiving emails from it, send an email to leveldb+***@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Loading...