Everything posted by studiot
-
How can information (Shannon) entropy decrease ?
Sigh! This paragraph makes no sense and is totally irrelevant to the thread question. How can information entropy decrease ? Happily this question was ably demonstrated by @joigus direct calculation on my example, something you had ample opportunity to perform yourself, but chose not to do. This is now the third thread where you have avoided engaging in direct questions or comments about your posts, the other two being your wave thread and your experiments and information thread. This is a pity because in the case of the latter I supplied a direct answer to your chemistry question ( which you have not acknowledged). My answer here in this thread, without engaging set theory, is that as information entropy and information measure are not exactly inverse functions but reverse ones or contravarient onces, then as information measure increases (which it must do as one progresses through a calculation so you end up with more information (the result) than you started with) information entropy must decrease. I have also pointed out (and once again you have not responded) that one limitation to this would be further times when the calculation is run, you already have the answer.
-
Empires down the ages...and the scientific trends they exhibit
I'm sorry, this opening post is so full of incorrect data as to belong in the trash can and put behind us all as quickly as possible. Can I suggest that you revisit your zero thread, where you might have asked a serious question but don't seem to have been back to consider the answers?
-
Proposed new entry requirements to UK Universities.
https://www.bbc.co.uk/news/education-60491719 Whilst I can see the need for at least some knowledge of these subjects, I consider this approach far too heavy handed. How would a modern day Ramanujan ever get into a UK university ? Or how about someone who wishes to follow a Masters in Hairdressing ?
-
How can information (Shannon) entropy decrease ?
So why did you 'aim' such personally abusive remarks instead of answering the question you still have not answered? So you are now shifting your ground, when I point out that the energy or entropy involved in computation (and it does not matter how long or how much) can vary simply because obtaining the result can take different routes. This is not the case with thermodynamics which is founded on the idea of route independence between defined states.
-
How can information (Shannon) entropy decrease ?
Thank you for a thoughtful, pleasant and cooperative reply. An example to everyone. +1 I don't think I said that there is no cost to storing (and retrieval) - certainly I did not mean to imply that. Here is an admitedly extreme example. Let us suppose the computation takes 3 hours of running the met office supercomputer and the output result is the temperature at 9 pm in Trafalgar Square at 7.3oC. How much resource does it take to store the result compared to how much it would take to exactly repeat the calculation ? I will certainly look at your references with interest.
-
Order of self-studying
-
How can information (Shannon) entropy decrease ?
Ok. Maybe tomorrow if I can find the time. p.s. Please state exactly why you think building a computer that does nothing, so doesn't generate any heat, is a counterexample to what I said. I don't see this as a difference difference between thermodynamic entropy and Shannon (or Hartley) entropy or any statement about the Second Law. Since you don't want to answer the question, for my part I think the most significant difference is that Once you have perfomed a computation and incurred whatever resource price the universe exacts in terms of energy, entropy etc, you do not have to incur those costs again since the result of that computation is then known, the next time it is required. However in thermodynamics the universe exacts its pound of flesh each and every time the given process is run or occurs.
-
Is Religion being treated Differently?
+1
-
War Games: Russia Takes Ukraine, China Takes Taiwan. US Response?
Excellently thought out and presented post. +1 I see from the map that Russia has now secured its land route (corridor) to the Crimea.
-
Is Religion being treated Differently?
No. The name of this website is ScienceForums. As I understand the structure and rules, Serious subjects have a scientific aspect and many of these subjects are given a special section within the website for discussion of these scientific aspects. Religion is one of these. Such discussion involves criticism used in its proper meaning. The proper non colloquial meaning does not involve disparagement. This website also has a section where you can say "I hate Jesus, your cat, Allah, Buddha, big band music, the colour of your tie, or whatever" That section is called "The Lounge". However such proclaimations are unlikely to gain you much traction as they bore most scientifically mined folks. In fact the whole subject of religion bores me personally, and I would prefer it scrapped altogether. But I accept that there are scientific aspects of it, so I accept that others want it even if I don't, so long as they discuss the scientific aspects of it. The purpose of moderators is to moderate and the general concensus, not just my own opinion, is that they do a pretty good job for no reward. I personally have seen them listen to well reasoned requests and put a good deal of their own time and collective effort into making changes, where they have the power to so do. It should be acknowledged that they do not always have this power over matters which are set by the site's owners.
-
Paper: A causal mechanism for gravity
What an excellent post all round. +1
-
How can information (Shannon) entropy decrease ?
Do you deny the mathematics of the identity transformation ? Or do you deny that a computer that can perform exactly one transformation (the identity transformation) is a computer ?
-
How can information (Shannon) entropy decrease ?
Thank you for trying. Please state exactly what you think is the difference between thermodynamic entropy and Shannon (or Hartley) entropy and what exactly you think the Second Law says about both of them.
-
How can information (Shannon) entropy decrease ?
Well I'm sorry if all you want to do is make unqualified generalistic pronouncements , one counter example is enough to disprove your claim. Mathematical theory requires that there be such a thing as 'the identity transformation' for any operation or transformation. Such a transformation require exactly zero energy since no change occurs. However I would much rather you entered a proper discussion like other members here and addressed some of the points, posted for your benefit. You have made no visible attempt to answer the question posed in the opening post or thread title or to discuss entropy.
-
Zero is a number, and the big bang proves it.
Quite so. In fact it is a member of many sets, for example the integers, the rationals, the set of all even numbers, the set of all squares of numbers.................. It is also the 'additive inverse' in set theory axioms for instance in peano's axioms of arithmetic. But I was giving the OP the benefit of the doubt as they say, as to what he was really trying to say, rather than just telling him he was wrong. Especially not to offer incorrect information.
-
Zero is a number, and the big bang proves it.
How do you expect me to clarify it and why do you think I said ? I also copied a short quote to explain why I wondered if the OP meant imaginary when he said virtual. I will repeat that quote in case you did not read it. Look for the phrase 'unusual terminology'.
-
Zero is a number, and the big bang proves it.
If you don't know 'whatever it means', how can you declare that zero is not a virtual number ? Zero is, in fact, a valid and necessary member of the set of imaginary numbers, which may be what the OP means. I have already asked for clarification I also note there are some other inconsistencies in the rest of your post that need addressing.
-
Experiments and information
Kirchhoff (with two h's and two f's) was a 'polymath', who also contributed to Chemistry, particularly in the domain of chemical thermodynamics. And yes there is such a law, though it was not due to K but a gentleman named Hess. Hesse's Law and Hess Cycles. https://en.wikipedia.org/wiki/Hess's_law +1 for interesting developments of your musings. I have also mentioned them in my thread on entropy and information.
-
How can information (Shannon) entropy decrease ?
No it isn't. This is where my RAM example comes in. The information may be set but unavailable, which has the same effect as being reset. This would be an example of the Caratheodory version of the second law. "In any system, there are nearby local states that are unavailable to the system" A computation that involves no energy is the topological transformation of a square to a circle. The information is available whether the actual transformation is performed or not and whether the necessary topological theory has ever been conceived, let alone enacted. You have now also mentioned this idea Thank you for spelling all that out in detail +1 My apologies, I didn't lin to the originating thread. https://www.scienceforums.net/topic/126656-experiments-and-information/?tab=comments#comment-1200346
-
How can information (Shannon) entropy decrease ?
I like the first part. But this part runs into the difficulty I mentioned with the RAM chip. Notably the different erasure methods. For instance I can simply switch off the power to that chip. Or I can cut one or more address lines making the given cell unavailable. Or I can perform the more conventional activation of the appropriate address lines and then overwrite a zero into the given cell. I am sure there are more options.
-
Surface waves in a liquid
Yes this is a damped oscillation, as you say, but there is more going on that. I'm not sure what part of my post you were responding to though.
-
How can information (Shannon) entropy decrease ?
OK, thanks for the replies. Here is my process example for idscussion. I have a 4 x 4 square board as in the diagram. On one square I have placed a coin but you cannot see it (you can see the one in the diagram for the purposes of explanation) In order to 'win' the coin you ask questions that may only be answered yes or no, represented by 1 (yes) and 0 (no) When you think you have determined the position of the coin you represent the answers to your questions by a string of ones and zeros. Using the example Is it in the first column? - No Is it in the second column? - Yes Is it in the first row? - No Is it in the second row? - Yes represented as information by the string 0101 What happens to the information entropy at each stage of the Q&A ?
-
How can information (Shannon) entropy decrease ?
The thread is inspired by a claim in a recent thread that information entropy, as defined by Shannon, is the same as the thermodynamic definition of entropy which obeys the Second Law and therefore cannot decrease. Is this correct ?
-
Surface waves in a liquid
I agree there is sometimes no bulk flow of matter. But how much momentum flows in the case of a standing wave ? This is not as I understand the mechanism
-
Experiments and information
By all means demonstrate that this is the case but consider this So let us consider computer memory chip, A RAM chip. So I agree it takes a specific amount of energy input to 'write' to one cell of the Ram chip. But there are several ways to effect erasure, each with their own energy cost. Note I have started a new thread, specifically to examine any correspondence between Shannon entropy and Thermodynamic entropy.